Max level shown:
12026-03-03T16:56:40.141ZDEBGtest_metrics (init_with_steps): Running step start_crdb
22026-03-03T16:56:40.141ZDEBGtest_metrics: Starting CRDB
32026-03-03T16:56:40.141ZINFOtest_metrics: cockroach temporary directory: /var/tmp/omicron_tmp/.tmpjXJ83b
42026-03-03T16:56:40.141ZINFOtest_metrics: cockroach: copying from seed tarball (/var/tmp/omicron_tmp/crdb-base-build/01a593466edfe10be8065d09575d9108ee70f096422ef511649ff51492c1a319.tar) to storage directory (/var/tmp/omicron_tmp/.tmpjXJ83b/data)
52026-03-03T16:56:40.151ZINFOtest_metrics: cockroach command line: cockroach start-single-node --insecure --http-addr=:0 --store=path=/var/tmp/omicron_tmp/.tmpjXJ83b/data,ballast-size=0 --listen-addr [::1]:0 --listening-url-file /var/tmp/omicron_tmp/.tmpjXJ83b/listen-url --max-sql-memory 256MiB
62026-03-03T16:56:40.151ZINFOtest_metrics: cockroach environment: BUILDOMAT_JOB_ID=01KJT89G6C776EQB6BAC473AHC BUILDOMAT_TASK_ID=4 CARGO=/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/bin/cargo CARGO_HOME=/home/build/.cargo CARGO_INCREMENTAL=0 CARGO_MANIFEST_DIR=/work/oxidecomputer/omicron/nexus CARGO_PKG_AUTHORS= CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_LICENSE=MPL-2.0 CARGO_PKG_LICENSE_FILE= CARGO_PKG_NAME=omicron-nexus CARGO_PKG_REPOSITORY= CARGO_PKG_RUST_VERSION= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= CARGO_TERM_COLOR=always CI=true CRDB_SEED_TAR=/var/tmp/omicron_tmp/crdb-base-build/01a593466edfe10be8065d09575d9108ee70f096422ef511649ff51492c1a319.tar GITHUB_BRANCH=ea-ztnrpmzzkqvp GITHUB_REF=refs/heads/ea-ztnrpmzzkqvp GITHUB_REPOSITORY=oxidecomputer/omicron GITHUB_SHA=c07c7685c434eb5b35e41fa764918d3deb749829 GOTRACEBACK=crash HOME=/home/build LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 LD_LIBRARY_PATH=/work/oxidecomputer/omicron/target/debug/build/aws-lc-sys-f7ed203bc494f61c/out:/work/oxidecomputer/omicron/target/debug/build/blake3-f343411090537ee9/out:/work/oxidecomputer/omicron/target/debug/build/bzip2-sys-84e3a942d0ba32cb/out/lib:/work/oxidecomputer/omicron/target/debug/build/libgit2-sys-22a9fe5c9961762c/out/build:/work/oxidecomputer/omicron/target/debug/build/libz-sys-a45bcc1bdf81d4f5/out/lib:/work/oxidecomputer/omicron/target/debug/build/psm-7171f0fac820b0ee/out:/work/oxidecomputer/omicron/target/debug/build/ring-970c0722df753325/out:/work/oxidecomputer/omicron/target/debug/build/tofino-97249330d8dd6530/out:/work/oxidecomputer/omicron/target/debug/build/zstd-sys-4ce5ac15611f058d/out:/work/oxidecomputer/omicron/target/debug/deps:/work/oxidecomputer/omicron/target/debug:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib LOGNAME=build NEXTEST=1 NEXTEST_ATTEMPT=1 NEXTEST_ATTEMPT_ID=970c3d26-cdb0-44e7-af90-12d13fee6235:omicron-nexus::test_all$integration_tests::metrics::test_metrics NEXTEST_BINARY_ID=omicron-nexus::test_all NEXTEST_BIN_EXE_nexus=/work/oxidecomputer/omicron/target/debug/nexus NEXTEST_BIN_EXE_schema-updater=/work/oxidecomputer/omicron/target/debug/schema-updater NEXTEST_BIN_EXE_schema_updater=/work/oxidecomputer/omicron/target/debug/schema-updater NEXTEST_EXECUTION_MODE=process-per-test NEXTEST_LD_LIBRARY_PATH=/work/oxidecomputer/omicron/target/debug/build/aws-lc-sys-f7ed203bc494f61c/out:/work/oxidecomputer/omicron/target/debug/build/blake3-f343411090537ee9/out:/work/oxidecomputer/omicron/target/debug/build/bzip2-sys-84e3a942d0ba32cb/out/lib:/work/oxidecomputer/omicron/target/debug/build/libgit2-sys-22a9fe5c9961762c/out/build:/work/oxidecomputer/omicron/target/debug/build/libz-sys-a45bcc1bdf81d4f5/out/lib:/work/oxidecomputer/omicron/target/debug/build/psm-7171f0fac820b0ee/out:/work/oxidecomputer/omicron/target/debug/build/ring-970c0722df753325/out:/work/oxidecomputer/omicron/target/debug/build/tofino-97249330d8dd6530/out:/work/oxidecomputer/omicron/target/debug/build/zstd-sys-4ce5ac15611f058d/out:/work/oxidecomputer/omicron/target/debug/deps:/work/oxidecomputer/omicron/target/debug:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib NEXTEST_PROFILE=ci NEXTEST_RUN_ID=970c3d26-cdb0-44e7-af90-12d13fee6235 NEXTEST_RUN_MODE=test NEXTEST_STATE_DIR=/tmp/nextest-state.iDVJbI NEXTEST_STRESS_CURRENT=none NEXTEST_STRESS_TOTAL=none NEXTEST_TEST_GLOBAL_SLOT=0 NEXTEST_TEST_GROUP=@global NEXTEST_TEST_GROUP_SLOT=none NEXTEST_TEST_NAME=integration_tests::metrics::test_metrics NEXTEST_TEST_PHASE=run NEXTEST_TOTAL_ATTEMPTS=1 OUT_DIR=/work/oxidecomputer/omicron/target/debug/build/omicron-nexus-459a70e126ba99a1/out PATH=/work/oxidecomputer/omicron/out/mgd/root/opt/oxide/mgd/bin:/work/oxidecomputer/omicron/out/dendrite-stub/bin:/work/oxidecomputer/omicron/out/clickhouse:/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin PWD=/work/oxidecomputer/omicron RUSTC_BOOTSTRAP=1 RUSTDOCFLAGS=--document-private-items -D warnings RUSTFLAGS=--cfg tokio_unstable -D warnings RUSTUP_HOME=/home/build/.rustup RUSTUP_TOOLCHAIN=1.91.1-x86_64-unknown-linux-gnu RUST_BACKTRACE=1 RUST_RECURSION_COUNT=1 SHLVL=1 SSL_CERT_DIR=/usr/lib/ssl/certs SSL_CERT_FILE=/usr/lib/ssl/certs/ca-certificates.crt TMPDIR=/var/tmp/omicron_tmp TZ=UTC USER=build
72026-03-03T16:56:41.146ZINFOtest_metrics: cockroach pid: 237026
82026-03-03T16:56:41.146ZINFOtest_metrics: cockroach listen URL: postgresql://root@[::1]:32943/omicron?sslmode=disable
92026-03-03T16:56:41.155ZDEBGtest_metrics (init_with_steps): Running step start_clickhouse
102026-03-03T16:56:41.155ZDEBGtest_metrics: Starting Clickhouse
112026-03-03T16:56:41.667ZDEBGtest_metrics (init_with_steps): Running step start_internal_dns
122026-03-03T16:56:41.667ZINFOtest_metrics (store): opening sled database path = /var/tmp/omicron_tmp/.tmpyPLzuD
132026-03-03T16:56:41.692ZINFOtest_metrics (store): pruning trees for generations newer than 0
142026-03-03T16:56:41.692ZINFOtest_metrics (store): pruning trees for generations older than 0 keep = 3
152026-03-03T16:56:41.692ZINFOtest_metrics (dns): DNS server bound to address kind = dns local_address = [::1]:55171
162026-03-03T16:56:41.692ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:43957 method = GET path = /config versions = all starting from 2.0.0
172026-03-03T16:56:41.692ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:43957 method = GET path = /config versions = from 1.0.0 to 2.0.0
182026-03-03T16:56:41.692ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:43957 method = PUT path = /config versions = all starting from 2.0.0
192026-03-03T16:56:41.692ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:43957 method = PUT path = /config versions = from 1.0.0 to 2.0.0
202026-03-03T16:56:41.692ZINFOtest_metrics (http): listening kind = dns local_addr = [::1]:43957
212026-03-03T16:56:41.692ZDEBGtest_metrics (http): successfully registered DTrace USDT probes kind = dns local_addr = [::1]:43957
222026-03-03T16:56:41.692ZDEBGtest_metrics (init_with_steps): Running step start_external_dns
232026-03-03T16:56:41.692ZINFOtest_metrics (store): opening sled database path = /var/tmp/omicron_tmp/.tmp0mfaJx
242026-03-03T16:56:41.693ZINFOtest_metrics (store): pruning trees for generations newer than 0
252026-03-03T16:56:41.694ZINFOtest_metrics (store): pruning trees for generations older than 0 keep = 3
262026-03-03T16:56:41.694ZINFOtest_metrics (dns): DNS server bound to address kind = dns local_address = [::1]:53464
272026-03-03T16:56:41.694ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:39361 method = GET path = /config versions = all starting from 2.0.0
282026-03-03T16:56:41.694ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:39361 method = GET path = /config versions = from 1.0.0 to 2.0.0
292026-03-03T16:56:41.695ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:39361 method = PUT path = /config versions = all starting from 2.0.0
302026-03-03T16:56:41.695ZDEBGtest_metrics (http): registered endpoint kind = dns local_addr = [::1]:39361 method = PUT path = /config versions = from 1.0.0 to 2.0.0
312026-03-03T16:56:41.695ZINFOtest_metrics (http): listening kind = dns local_addr = [::1]:39361
322026-03-03T16:56:41.695ZDEBGtest_metrics (http): successfully registered DTrace USDT probes kind = dns local_addr = [::1]:39361
332026-03-03T16:56:41.695ZDEBGtest_metrics (init_with_steps): Running step start_nexus_internal
342026-03-03T16:56:41.695ZDEBGtest_metrics: Starting Nexus (internal API)
352026-03-03T16:56:41.695ZINFOtest_metrics: setting up nexus server
362026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = Action
372026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = AuditLog
382026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = AnyActor
392026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = AuthenticatedActor
402026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = BlueprintConfig
412026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = Database
422026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = DnsConfig
432026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = Fleet
442026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = Inventory
452026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = IpPoolList
462026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = VpcList
472026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = ConsoleSessionList
482026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = DeviceAuthRequestList
492026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = QuiesceState
502026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = SiloCertificateList
512026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = SiloGroupList
522026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = SiloIdentityProviderList
532026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = SiloUserList
542026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = SiloUserSessionList
552026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = SiloUserTokenList
562026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = SubnetPoolList
572026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = UpdateTrustRootList
582026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = TargetReleaseConfig
592026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = AlertClassList
602026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = ScimClientBearerTokenList
612026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = MulticastGroupList
622026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = Project
632026-03-03T16:56:41.695ZINFOtest_metrics (ServerContext): registering Oso class class = Disk
642026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Snapshot
652026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = ProjectImage
662026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = AffinityGroup
672026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = AntiAffinityGroup
682026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Instance
692026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = IpPool
702026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = InstanceNetworkInterface
712026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Vpc
722026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = VpcRouter
732026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = InternetGateway
742026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = InternetGatewayIpPool
752026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = InternetGatewayIpAddress
762026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = RouterRoute
772026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = VpcSubnet
782026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = FloatingIp
792026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = ExternalSubnet
802026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Image
812026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = SiloImage
822026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = AddressLot
832026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Blueprint
842026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = LoopbackAddress
852026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Certificate
862026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = ConsoleSession
872026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = DeviceAuthRequest
882026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = DeviceAccessToken
892026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = PhysicalDisk
902026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Rack
912026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = SshKey
922026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Silo
932026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = SiloUser
942026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = SiloGroup
952026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = SupportBundle
962026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = IdentityProvider
972026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = SamlIdentityProvider
982026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Sled
992026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = SubnetPool
1002026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = TufRepo
1012026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = TufArtifact
1022026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = TufTrustRoot
1032026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Alert
1042026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = AlertReceiver
1052026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = WebhookSecret
1062026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Zpool
1072026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = Service
1082026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = UserBuiltin
1092026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = ScimClientBearerToken
1102026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): registering Oso class class = MulticastGroup
1112026-03-03T16:56:41.700ZINFOtest_metrics (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations; grants project.admin on all projects)\n# - silo.limited-collaborator (grants project.limited-collaborator on all projects)\n# - silo.viewer (can read most resources within the Silo; grants project.viewer)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project, including networking)\n# - project.limited-collaborator (can manage compute resources, but not networking resources)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\n# Note that certain Actors may not ever have any roles assigned to them, like\n# SCIM Actors.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "limited-collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "limited-collaborator";\n\t"limited-collaborator" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif actor.is_user and silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "limited-collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t# Role hierarchy: admin > collaborator > limited-collaborator > viewer\n\t#\n\t# The "limited-collaborator" role can create/modify non-networking\n\t# resources (instances, disks, etc.) but cannot create/modify networking\n\t# infrastructure (VPCs, subnets, routers, internet gateways).\n\t# See nexus/authz-macros for InProjectLimited vs InProjectFull.\n\t"viewer" if "limited-collaborator";\n\t"limited-collaborator" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "limited-collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"limited-collaborator" if "limited-collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if actor.is_user and silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n}\n# We want to allow the user to modify the ssh key but disallow a SCIM IdP token\n# from doing the same.\nhas_permission(actor: AuthenticatedActor, "modify", ssh_key: SshKey)\n\tif actor.is_user and has_permission(actor, "modify", ssh_key.silo_user);\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource ScimClientBearerToken {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n # necessary to authenticate SCIM actors\n\t"read" if "external-authenticator" on "parent_fleet";\n\n\t# Silo-level roles grant privileges for SCIM client tokens.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges for SCIM client tokens.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", scim_client_bearer_token: ScimClientBearerToken)\n\tif scim_client_bearer_token.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: ScimClientBearerToken)\n\tif collection.silo.fleet = fleet;\n\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the quiesce state of a particular Nexus instance.\n#\n# These authz checks must not require the database. We grant this directly to\n# callers of the internal API.\nresource QuiesceState {\n\tpermissions = [ "read", "modify" ];\n}\nhas_permission(USER_INTERNAL_API: AuthenticatedActor, "read", _q: QuiesceState);\nhas_permission(\n USER_INTERNAL_API: AuthenticatedActor,\n "modify",\n _q: QuiesceState\n);\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/update/trust-roots" in the API\nresource UpdateTrustRootList {\n\tpermissions = [ "list_children", "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"list_children" if "viewer" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: UpdateTrustRootList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource TargetReleaseConfig {\n\tpermissions = [\n\t "read", # read the current target release\n\t "modify", # change the current target release\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", resource: TargetReleaseConfig)\n\tif resource.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif actor.is_user and silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for accessing "/v1/multicast-groups" in the API\n# Groups are created when the first instance joins and deleted when the last leaves.\nresource MulticastGroupList {\n\tpermissions = [ "list_children" ];\n\n\trelations = { parent_fleet: Fleet };\n\n\t# Fleet Viewers can list multicast groups\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", multicast_group_list: MulticastGroupList)\n\tif multicast_group_list.fleet = fleet;\n\n# Any authenticated user can list multicast groups in their fleet.\n# This enables silo users to discover groups for attaching instances,\n# without requiring the Fleet::Viewer role.\nhas_permission(actor: AuthenticatedActor, "list_children", multicast_group_list: MulticastGroupList)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group_list.fleet;\n\n# MulticastGroup is a fleet-level discovery resource.\n# Join/leave authorization is gated by Instance::Modify, not the group itself.\nresource MulticastGroup {\n\tpermissions = [ "read", "list_children" ];\n\trelations = { parent_fleet: Fleet };\n}\nhas_relation(fleet: Fleet, "parent_fleet", multicast_group: MulticastGroup)\n\tif multicast_group.fleet = fleet;\n\n# Any authenticated user can read multicast groups in their fleet\nhas_permission(actor: AuthenticatedActor, "read", multicast_group: MulticastGroup)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group.fleet;\n\n# Any authenticated user can list members of multicast groups in their fleet\nhas_permission(actor: AuthenticatedActor, "list_children", multicast_group: MulticastGroup)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group.fleet;\n\n# Describes the policy for reading and writing the audit log\nresource AuditLog {\n\tpermissions = [\n\t "list_children", # retrieve audit log\n\t "create_child", # create audit log entry\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\n\t# Fleet viewers can read the audit log\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\n# Any actor should be able to write to the audit log because we need to be able\n# to write to the log from any request, authenticated or not. Audit log writes\n# are always a byproduct of other operations: there are no endpoints that allow\n# the user to write to the log deliberately. Note we use AuthenticatedActor\n# because we don't really mean unauthenticated -- in the case of login\n# operations, we use the external authenticator actor that creates the session\n# to authorize the audit log write.\nhas_permission(_actor: AuthenticatedActor, "create_child", _audit_log: AuditLog);\n\nhas_relation(fleet: Fleet, "parent_fleet", audit_log: AuditLog)\n\tif audit_log.fleet = fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Allow silo admins to delete and list user sessions\nresource SiloUserSessionList {\n permissions = [ "modify", "list_children" ];\n relations = { parent_silo: Silo };\n\n # A silo admin can modify (e.g., delete) a user's sessions.\n "modify" if "admin" on "parent_silo";\n\n # A silo admin can list a user's sessions.\n "list_children" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", authn_list: SiloUserSessionList)\n if authn_list.silo_user.silo = silo;\n\n# give users 'modify' and 'list_children' on their own sessions\nhas_permission(actor: AuthenticatedActor, "modify", authn_list: SiloUserSessionList)\n if actor.equals_silo_user(authn_list.silo_user);\nhas_permission(actor: AuthenticatedActor, "list_children", authn_list: SiloUserSessionList)\n if actor.equals_silo_user(authn_list.silo_user);\n\n# Allow silo admins to delete and list user access tokens\nresource SiloUserTokenList {\n permissions = [ "modify", "list_children" ];\n relations = { parent_silo: Silo };\n\n # A silo admin can modify (e.g., delete) a user's tokens.\n "modify" if "admin" on "parent_silo";\n\n # A silo admin can list a user's tokens.\n "list_children" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", authn_list: SiloUserTokenList)\n if authn_list.silo_user.silo = silo;\n\n# give users 'modify' and 'list_children' on their own tokens\nhas_permission(actor: AuthenticatedActor, "modify", authn_list: SiloUserTokenList)\n if actor.equals_silo_user(authn_list.silo_user);\nhas_permission(actor: AuthenticatedActor, "list_children", authn_list: SiloUserTokenList)\n if actor.equals_silo_user(authn_list.silo_user);\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# Grant SCIM IdP actors the permissions they need on users.\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if actor.is_scim_idp and silo_user.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "create_child", silo_user_list: SiloUserList)\n\tif actor.is_scim_idp and silo_user_list.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "modify", silo_user: SiloUser)\n\tif actor.is_scim_idp and silo_user.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "list_children", silo_user_list: SiloUserList)\n if actor.is_scim_idp and silo_user_list.silo in actor.silo;\n\n# Describes the policy for creating and managing Silo groups (mostly intended\n# for API-managed groups)\nresource SiloGroupList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the groups in the\n\t# Silo) can see the groups in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's groups. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloGroupList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloGroupList)\n\tif collection.silo.fleet = fleet;\n\n# Grant SCIM IdP actors the permissions they need on groups.\nhas_permission(actor: AuthenticatedActor, "read", silo_group: SiloGroup)\n if actor.is_scim_idp and silo_group.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "create_child", silo_group_list: SiloGroupList)\n\tif actor.is_scim_idp and silo_group_list.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "modify", silo_group: SiloGroup)\n\tif actor.is_scim_idp and silo_group.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "list_children", silo_group_list: SiloGroupList)\n if actor.is_scim_idp and silo_group_list.silo in actor.silo;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest)\n if actor.is_user;\nhas_permission(actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest)\n if actor.is_user;\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\nresource WebhookSecret {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_alert_receiver: AlertReceiver };\n\n\t"read" if "read" on "parent_alert_receiver";\n\t"modify" if "modify" on "parent_alert_receiver";\n}\n\nhas_relation(rx: AlertReceiver, "parent_alert_receiver", secret: WebhookSecret)\n\tif secret.alert_receiver = rx;\n\nresource AlertClassList {\n\tpermissions = [ "list_children" ];\n\trelations = { parent_fleet: Fleet };\n\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", collection: AlertClassList)\n\tif collection.fleet = fleet;\n\nresource ScimClientBearerTokenList {\n\tpermissions = [ "create_child", "list_children" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges for SCIM client tokens.\n # These are all admin because being able to create these tokens would allow\n # a user to grant themselves admin by modifying group membership through SCIM calls\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_silo";\n\n # Fleet-level roles also grant privileges for SCIM client tokens, for\n # configuration before silo admins are present.\n\t"create_child" if "admin" on "parent_fleet";\n\t"list_children" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", scim_client_bearer_token_list: ScimClientBearerTokenList)\n\tif scim_client_bearer_token_list.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: ScimClientBearerTokenList)\n\tif collection.silo.fleet = fleet;\n\n# VpcList is a synthetic resource for controlling VPC creation.\n# Unlike other project resources, VPC creation requires the full "collaborator"\n# role rather than "limited-collaborator", enforcing the networking restriction.\n# This allows organizations to restrict who can reconfigure the network topology\n# while still allowing users with limited-collaborator to work with compute\n# resources (instances, disks, etc.) within the existing network.\nresource VpcList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { containing_project: Project };\n\n\t"list_children" if "read" on "containing_project";\n\t"create_child" if "collaborator" on "containing_project";\n}\nhas_relation(project: Project, "containing_project", collection: VpcList)\n\tif collection.project = project;\n\n# Describes the policy for accessing "/v1/system/subnet-pools" in the API\nresource SubnetPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the Subnet Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list External Subnet Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", subnet_pool_list: SubnetPoolList)\n\tif subnet_pool_list.fleet = fleet;\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource AffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AffinityGroup)\n if child.project = parent;\n \n\n resource AntiAffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AntiAffinityGroup)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource ExternalSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ExternalSubnet)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n\n\n\n\n resource SupportBundle {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SupportBundle)\n if child.fleet = fleet;\n \n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource SubnetPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SubnetPool)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource TufTrustRoot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufTrustRoot)\n if child.fleet = fleet;\n \n\n resource Alert {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Alert)\n if child.fleet = fleet;\n \n\n resource AlertReceiver {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AlertReceiver)\n if child.fleet = fleet;\n \n\n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n \n\n
1122026-03-03T16:56:41.712ZINFOtest_metrics (ServerContext): Setting up resolver using DNS address: [::1]:55171
1132026-03-03T16:56:41.712ZINFOtest_metrics (DnsResolver): new DNS resolver addresses = [[::1]:55171]
1142026-03-03T16:56:41.712ZINFOtest_metrics (ServerContext): Setting up qorb database pool from a single host url = PostgresConfigWithUrl {\n url_raw: "postgresql://root@[::1]:32943/omicron?sslmode=disable",\n config: Config {\n user: Some(\n "root",\n ),\n password: None,\n dbname: Some(\n "omicron",\n ),\n options: None,\n application_name: None,\n ssl_mode: Disable,\n host: [\n Tcp(\n "::1",\n ),\n ],\n hostaddr: [],\n port: [\n 32943,\n ],\n connect_timeout: None,\n tcp_user_timeout: None,\n keepalives: true,\n keepalives_idle: 7200s,\n keepalives_interval: None,\n keepalives_retries: None,\n target_session_attrs: Any,\n channel_binding: Prefer,\n load_balance_hosts: Disable,\n },\n}
1152026-03-03T16:56:41.712ZDEBGtest_metrics (ServerContext): registered USDT probes
1162026-03-03T16:56:41.972ZINFOtest_metrics (datastore): Database schema version is up to date desired_version = 233.0.0 found_version = 233.0.0
1172026-03-03T16:56:41.976ZWARNtest_metrics (datastore): No db_metadata_nexus records exist - skipping access check explanation = This is expected during initial deployment or before migration nexus_id = 913233fe-92a8-4635-9572-183f495429c4 (omicron_zone)
1182026-03-03T16:56:41.976ZINFOtest_metrics (nexus): Datastore is ready for usage
1192026-03-03T16:56:42.005ZDEBGtest_metrics (clickhouse-client): registered USDT probes id = 0bd623cd-5825-4477-b3ca-107a738cbd60
1202026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
1212026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
1222026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
1232026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
1242026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1252026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1262026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = PUT path = /disks/{disk_id} versions = all
1272026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /metrics/collectors versions = all
1282026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1292026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /metrics/producers versions = all
1302026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1312026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = GET path = /probes/{sled} versions = all
1322026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /refresh-vpc-routes versions = all
1332026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = GET path = /sled-agents/{sled_id} versions = all
1342026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /sled-agents/{sled_id} versions = all
1352026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = PUT path = /switch/{switch_id} versions = all
1362026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = GET path = /v1/ping versions = all
1372026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = PUT path = /vmms/{propolis_id} versions = all
1382026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:46333 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1392026-03-03T16:56:42.015ZINFOtest_metrics (dropshot_internal): listening local_addr = 127.0.0.1:46333
1402026-03-03T16:56:42.015ZDEBGtest_metrics (dropshot_internal): successfully registered DTrace USDT probes local_addr = 127.0.0.1:46333
1412026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /bgtasks versions = all
1422026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /bgtasks/activate versions = all
1432026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /bgtasks/view/{bgtask_name} versions = all
1442026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /clickhouse/policy versions = all
1452026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /clickhouse/policy versions = all
1462026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /debug/fetch-omdb-binary versions = all
1472026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /demo-saga versions = all
1482026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1492026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /deployment/blueprints/all versions = all
1502026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1512026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1522026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /deployment/blueprints/import versions = all
1532026-03-03T16:56:42.016ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /deployment/blueprints/regenerate versions = all
1542026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /deployment/blueprints/target versions = all
1552026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /deployment/blueprints/target versions = all
1562026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = PUT path = /deployment/blueprints/target/enabled versions = all
1572026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /deployment/reconfigurator-config versions = all
1582026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /deployment/reconfigurator-config versions = all
1592026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /deployment/reconfigurator-config/{version} versions = all
1602026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /deployment/update-status versions = all
1612026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /experimental/v1/system/support-bundles versions = all
1622026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /experimental/v1/system/support-bundles versions = all
1632026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1642026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1652026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = PUT path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1662026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
1672026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
1682026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
1692026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
1702026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
1712026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /instances/{instance_id}/migrate versions = all
1722026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /mgs-updates versions = all
1732026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /oximeter/read-policy versions = all
1742026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /oximeter/read-policy versions = all
1752026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /physical-disk/expunge versions = all
1762026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /quiesce versions = all
1772026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /quiesce versions = all
1782026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1792026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /sagas versions = all
1802026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /sagas/{saga_id} versions = all
1812026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /sleds/expunge versions = all
1822026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /sleds/uninitialized versions = all
1832026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /trust-quorum/config/{rack_id} versions = all
1842026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /trust-quorum/lrtq-upgrade versions = all
1852026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = POST path = /trust-quorum/remove/{sled} versions = all
1862026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:32891 method = GET path = /v1/ping versions = all
1872026-03-03T16:56:42.017ZINFOtest_metrics (dropshot_lockstep): listening local_addr = 127.0.0.1:32891
1882026-03-03T16:56:42.017ZDEBGtest_metrics (dropshot_lockstep): successfully registered DTrace USDT probes local_addr = 127.0.0.1:32891
1892026-03-03T16:56:42.017ZINFOtest_metrics (SEC): SEC running sec_id = 913233fe-92a8-4635-9572-183f495429c4
1902026-03-03T16:56:42.017ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
1912026-03-03T16:56:42.017ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
1922026-03-03T16:56:42.019ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
1932026-03-03T16:56:42.019ZDEBGtest_metrics (DataLoader): attempting to create built-in users
1942026-03-03T16:56:42.019ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
1952026-03-03T16:56:42.019ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
1962026-03-03T16:56:42.019ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
1972026-03-03T16:56:42.074ZINFOtest_metrics (MgsUpdateDriver): starting MgsUpdateDriver
1982026-03-03T16:56:42.076ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 78 43 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 xC..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:50915 req_id = 4f4a0210-3cde-4252-98a7-1425751a1ea5
1992026-03-03T16:56:42.076ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 30787,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:50915 req_id = 4f4a0210-3cde-4252-98a7-1425751a1ea5
2002026-03-03T16:56:42.077ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30787, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:50915 req_id = 4f4a0210-3cde-4252-98a7-1425751a1ea5
2012026-03-03T16:56:42.077ZTRACtest_metrics (dns): buffer buffer = Length: 74 (0x4a) bytes\n0000: f2 dc 01 00 00 01 00 00 00 00 00 01 0b 5f 72 65 ............._re\n0010: 70 6f 2d 64 65 70 6f 74 04 5f 74 63 70 0d 63 6f po-depot._tcp.co\n0020: 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 ntrol-plane.oxid\n0030: 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 e.internal..!...\n0040: 00 29 04 d0 00 00 00 00 00 00 .)........ kind = dns peer_addr = [::1]:59526 req_id = 91a95e6d-2e37-4c1a-aa17-74d323554d31
2022026-03-03T16:56:42.077ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62172,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_repo-depot._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_repo-depot._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 11,\n 95,\n 114,\n 101,\n 112,\n 111,\n 45,\n 100,\n 101,\n 112,\n 111,\n 116,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:59526 req_id = 91a95e6d-2e37-4c1a-aa17-74d323554d31
2032026-03-03T16:56:42.077ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 62172, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_repo-depot._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_repo-depot._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 11, 95, 114, 101, 112, 111, 45, 100, 101, 112, 111, 116, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_repo-depot._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:59526 req_id = 91a95e6d-2e37-4c1a-aa17-74d323554d31
2042026-03-03T16:56:42.077ZTRACtest_metrics (dns): buffer buffer = Length: 79 (0x4f) bytes\n0000: 97 cf 01 00 00 01 00 00 00 00 00 01 10 5f 63 72 ............._cr\n0010: 75 63 69 62 6c 65 2d 70 61 6e 74 72 79 04 5f 74 ucible-pantry._t\n0020: 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 cp.control-plane\n0030: 05 6f 78 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 .oxide.internal.\n0040: 00 21 00 01 00 00 29 04 d0 00 00 00 00 00 00 .!....)........ kind = dns peer_addr = [::1]:60668 req_id = f4470439-2cd3-46a7-aad2-a0e390cd25de
2052026-03-03T16:56:42.077ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 38863,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 16,\n 95,\n 99,\n 114,\n 117,\n 99,\n 105,\n 98,\n 108,\n 101,\n 45,\n 112,\n 97,\n 110,\n 116,\n 114,\n 121,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:60668 req_id = f4470439-2cd3-46a7-aad2-a0e390cd25de
2062026-03-03T16:56:42.077ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38863, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_crucible-pantry._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 16, 95, 99, 114, 117, 99, 105, 98, 108, 101, 45, 112, 97, 110, 116, 114, 121, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_crucible-pantry._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:60668 req_id = f4470439-2cd3-46a7-aad2-a0e390cd25de
2072026-03-03T16:56:42.092ZINFOtest_metrics (DataLoader): created 5 built-in users
2082026-03-03T16:56:42.092ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2092026-03-03T16:56:42.092ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2102026-03-03T16:56:42.093ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2112026-03-03T16:56:42.093ZDEBGtest_metrics (DataLoader): attempting to create built-in role assignments
2122026-03-03T16:56:42.093ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2132026-03-03T16:56:42.093ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2142026-03-03T16:56:42.094ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2152026-03-03T16:56:42.204ZINFOtest_metrics (DataLoader): created 4 built-in role assignments
2162026-03-03T16:56:42.204ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2172026-03-03T16:56:42.204ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2182026-03-03T16:56:42.206ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2192026-03-03T16:56:42.206ZDEBGtest_metrics (DataLoader): attempting to create built-in silos
2202026-03-03T16:56:42.206ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2212026-03-03T16:56:42.206ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2222026-03-03T16:56:42.206ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2232026-03-03T16:56:42.271ZINFOtest_metrics (DataLoader): created 2 built-in silos
2242026-03-03T16:56:42.271ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2252026-03-03T16:56:42.271ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2262026-03-03T16:56:42.271ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2272026-03-03T16:56:42.286ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2282026-03-03T16:56:42.286ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2292026-03-03T16:56:42.288ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2302026-03-03T16:56:42.288ZDEBGtest_metrics (DataLoader): attempting to create built-in projects
2312026-03-03T16:56:42.288ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2322026-03-03T16:56:42.288ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2332026-03-03T16:56:42.288ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2342026-03-03T16:56:42.302ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }
2352026-03-03T16:56:42.302ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2362026-03-03T16:56:42.302ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2372026-03-03T16:56:42.302ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2382026-03-03T16:56:42.302ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2392026-03-03T16:56:42.329ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2402026-03-03T16:56:42.329ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2412026-03-03T16:56:42.329ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2422026-03-03T16:56:42.330ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2432026-03-03T16:56:42.331ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2442026-03-03T16:56:42.334ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
2452026-03-03T16:56:42.334ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }
2462026-03-03T16:56:42.334ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2472026-03-03T16:56:42.334ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2482026-03-03T16:56:42.334ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2492026-03-03T16:56:42.334ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2502026-03-03T16:56:42.338ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2512026-03-03T16:56:42.338ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2522026-03-03T16:56:42.338ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2532026-03-03T16:56:42.338ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2542026-03-03T16:56:42.340ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2552026-03-03T16:56:42.342ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
2562026-03-03T16:56:42.342ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2572026-03-03T16:56:42.342ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2582026-03-03T16:56:42.342ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2592026-03-03T16:56:42.350ZINFOtest_metrics (DataLoader): created built-in services project
2602026-03-03T16:56:42.350ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2612026-03-03T16:56:42.350ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2622026-03-03T16:56:42.352ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2632026-03-03T16:56:42.352ZDEBGtest_metrics (DataLoader): attempting to create built-in VPCs
2642026-03-03T16:56:42.352ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2652026-03-03T16:56:42.352ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2662026-03-03T16:56:42.352ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2672026-03-03T16:56:42.354ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2682026-03-03T16:56:42.354ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2692026-03-03T16:56:42.354ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2702026-03-03T16:56:42.356ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }
2712026-03-03T16:56:42.356ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
2722026-03-03T16:56:42.356ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2732026-03-03T16:56:42.356ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2742026-03-03T16:56:42.356ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2752026-03-03T16:56:42.357ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2762026-03-03T16:56:42.357ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2772026-03-03T16:56:42.357ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2782026-03-03T16:56:42.357ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2792026-03-03T16:56:42.358ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2802026-03-03T16:56:42.358ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2812026-03-03T16:56:42.358ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2822026-03-03T16:56:42.359ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2832026-03-03T16:56:42.359ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2842026-03-03T16:56:42.363ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2852026-03-03T16:56:42.363ZTRACtest_metrics (DataLoader): successful lookup of siloed resource "Project" using built-in user
2862026-03-03T16:56:42.363ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }
2872026-03-03T16:56:42.363ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
2882026-03-03T16:56:42.363ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2892026-03-03T16:56:42.363ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2902026-03-03T16:56:42.364ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2912026-03-03T16:56:42.365ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2922026-03-03T16:56:42.365ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2932026-03-03T16:56:42.365ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2942026-03-03T16:56:42.365ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2952026-03-03T16:56:42.366ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2962026-03-03T16:56:42.366ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2972026-03-03T16:56:42.367ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2982026-03-03T16:56:42.367ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2992026-03-03T16:56:42.368ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3002026-03-03T16:56:42.372ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
3012026-03-03T16:56:42.372ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3022026-03-03T16:56:42.372ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3032026-03-03T16:56:42.372ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3042026-03-03T16:56:42.377ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }
3052026-03-03T16:56:42.377ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3062026-03-03T16:56:42.377ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3072026-03-03T16:56:42.377ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3082026-03-03T16:56:42.378ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3092026-03-03T16:56:42.383ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3102026-03-03T16:56:42.383ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3112026-03-03T16:56:42.383ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3122026-03-03T16:56:42.384ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3132026-03-03T16:56:42.386ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3142026-03-03T16:56:42.386ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3152026-03-03T16:56:42.386ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3162026-03-03T16:56:42.386ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3172026-03-03T16:56:42.387ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3182026-03-03T16:56:42.391ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
3192026-03-03T16:56:42.391ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3202026-03-03T16:56:42.391ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3212026-03-03T16:56:42.392ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3222026-03-03T16:56:42.395ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3232026-03-03T16:56:42.395ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3242026-03-03T16:56:42.395ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3252026-03-03T16:56:42.402ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3262026-03-03T16:56:42.402ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3272026-03-03T16:56:42.402ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3282026-03-03T16:56:42.408ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }
3292026-03-03T16:56:42.408ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3302026-03-03T16:56:42.408ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3312026-03-03T16:56:42.408ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3322026-03-03T16:56:42.408ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3332026-03-03T16:56:42.410ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3342026-03-03T16:56:42.410ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3352026-03-03T16:56:42.410ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3362026-03-03T16:56:42.411ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3372026-03-03T16:56:42.412ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3382026-03-03T16:56:42.412ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3392026-03-03T16:56:42.412ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3402026-03-03T16:56:42.412ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3412026-03-03T16:56:42.413ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3422026-03-03T16:56:42.417ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
3432026-03-03T16:56:42.417ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3442026-03-03T16:56:42.417ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3452026-03-03T16:56:42.418ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3462026-03-03T16:56:42.450ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
3472026-03-03T16:56:42.450ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3482026-03-03T16:56:42.450ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3492026-03-03T16:56:42.450ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3502026-03-03T16:56:42.451ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3512026-03-03T16:56:42.452ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3522026-03-03T16:56:42.452ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3532026-03-03T16:56:42.452ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3542026-03-03T16:56:42.453ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3552026-03-03T16:56:42.454ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3562026-03-03T16:56:42.454ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3572026-03-03T16:56:42.454ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3582026-03-03T16:56:42.454ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3592026-03-03T16:56:42.456ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3602026-03-03T16:56:42.460ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3612026-03-03T16:56:42.460ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3622026-03-03T16:56:42.460ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3632026-03-03T16:56:42.460ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3642026-03-03T16:56:42.503ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
3652026-03-03T16:56:42.503ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3662026-03-03T16:56:42.503ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3672026-03-03T16:56:42.503ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3682026-03-03T16:56:42.503ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3692026-03-03T16:56:42.504ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3702026-03-03T16:56:42.504ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3712026-03-03T16:56:42.504ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3722026-03-03T16:56:42.504ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3732026-03-03T16:56:42.505ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3742026-03-03T16:56:42.505ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3752026-03-03T16:56:42.505ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3762026-03-03T16:56:42.506ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3772026-03-03T16:56:42.507ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3782026-03-03T16:56:42.512ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3792026-03-03T16:56:42.512ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3802026-03-03T16:56:42.512ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3812026-03-03T16:56:42.512ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3822026-03-03T16:56:42.515ZDEBGtest_metrics (DataLoader): attempting to create built-in VPC firewall rules
3832026-03-03T16:56:42.515ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3842026-03-03T16:56:42.515ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3852026-03-03T16:56:42.515ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3862026-03-03T16:56:42.517ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3872026-03-03T16:56:42.517ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3882026-03-03T16:56:42.517ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3892026-03-03T16:56:42.518ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3902026-03-03T16:56:42.518ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3912026-03-03T16:56:42.518ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3922026-03-03T16:56:42.520ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
3932026-03-03T16:56:42.520ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3942026-03-03T16:56:42.520ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3952026-03-03T16:56:42.520ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3962026-03-03T16:56:42.520ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3972026-03-03T16:56:42.521ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3982026-03-03T16:56:42.521ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3992026-03-03T16:56:42.521ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4002026-03-03T16:56:42.521ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4012026-03-03T16:56:42.522ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4022026-03-03T16:56:42.522ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4032026-03-03T16:56:42.522ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4042026-03-03T16:56:42.523ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4052026-03-03T16:56:42.525ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4062026-03-03T16:56:42.529ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4072026-03-03T16:56:42.529ZTRACtest_metrics (DataLoader): successful lookup of siloed resource "Vpc" using built-in user
4082026-03-03T16:56:42.529ZTRACtest_metrics (DataLoader): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4092026-03-03T16:56:42.529ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4102026-03-03T16:56:42.529ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4112026-03-03T16:56:42.529ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4122026-03-03T16:56:42.529ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4132026-03-03T16:56:42.541ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4142026-03-03T16:56:42.541ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4152026-03-03T16:56:42.541ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4162026-03-03T16:56:42.541ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4172026-03-03T16:56:42.543ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4182026-03-03T16:56:42.543ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4192026-03-03T16:56:42.543ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4202026-03-03T16:56:42.543ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4212026-03-03T16:56:42.544ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4222026-03-03T16:56:42.549ZDEBGtest_metrics (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4232026-03-03T16:56:42.549ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4242026-03-03T16:56:42.549ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4252026-03-03T16:56:42.549ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4262026-03-03T16:56:42.553ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4272026-03-03T16:56:42.553ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4282026-03-03T16:56:42.553ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4292026-03-03T16:56:42.553ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4302026-03-03T16:56:42.553ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4312026-03-03T16:56:42.555ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4322026-03-03T16:56:42.555ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4332026-03-03T16:56:42.555ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4342026-03-03T16:56:42.555ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4352026-03-03T16:56:42.556ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4362026-03-03T16:56:42.556ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4372026-03-03T16:56:42.556ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4382026-03-03T16:56:42.556ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4392026-03-03T16:56:42.590ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4402026-03-03T16:56:42.594ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4412026-03-03T16:56:42.594ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4422026-03-03T16:56:42.594ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4432026-03-03T16:56:42.594ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4442026-03-03T16:56:42.658ZINFOtest_metrics (DataLoader): created built-in VPC firewall rules
4452026-03-03T16:56:42.658ZDEBGtest_metrics (DataLoader): attempting to create built-in VPC Subnets
4462026-03-03T16:56:42.658ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4472026-03-03T16:56:42.658ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4482026-03-03T16:56:42.658ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4492026-03-03T16:56:42.661ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4502026-03-03T16:56:42.661ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4512026-03-03T16:56:42.662ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4522026-03-03T16:56:42.667ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4532026-03-03T16:56:42.667ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4542026-03-03T16:56:42.668ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4552026-03-03T16:56:42.671ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4562026-03-03T16:56:42.671ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4572026-03-03T16:56:42.671ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4582026-03-03T16:56:42.671ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4592026-03-03T16:56:42.672ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4602026-03-03T16:56:42.673ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4612026-03-03T16:56:42.673ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4622026-03-03T16:56:42.673ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4632026-03-03T16:56:42.674ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4642026-03-03T16:56:42.676ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4652026-03-03T16:56:42.676ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4662026-03-03T16:56:42.676ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4672026-03-03T16:56:42.676ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4682026-03-03T16:56:42.677ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4692026-03-03T16:56:42.681ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4702026-03-03T16:56:42.681ZTRACtest_metrics (DataLoader): successful lookup of siloed resource "Vpc" using built-in user
4712026-03-03T16:56:42.681ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4722026-03-03T16:56:42.681ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4732026-03-03T16:56:42.681ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4742026-03-03T16:56:42.685ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4752026-03-03T16:56:42.685ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4762026-03-03T16:56:42.685ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4772026-03-03T16:56:42.685ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4782026-03-03T16:56:42.686ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4792026-03-03T16:56:42.687ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4802026-03-03T16:56:42.687ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4812026-03-03T16:56:42.687ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4822026-03-03T16:56:42.688ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4832026-03-03T16:56:42.689ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4842026-03-03T16:56:42.689ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4852026-03-03T16:56:42.689ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4862026-03-03T16:56:42.689ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4872026-03-03T16:56:42.691ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4882026-03-03T16:56:42.695ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4892026-03-03T16:56:42.698ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
4902026-03-03T16:56:42.699ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4912026-03-03T16:56:42.699ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4922026-03-03T16:56:42.699ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4932026-03-03T16:56:42.699ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4942026-03-03T16:56:42.700ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4952026-03-03T16:56:42.700ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4962026-03-03T16:56:42.700ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4972026-03-03T16:56:42.701ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4982026-03-03T16:56:42.702ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4992026-03-03T16:56:42.702ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5002026-03-03T16:56:42.702ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5012026-03-03T16:56:42.702ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5022026-03-03T16:56:42.704ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5032026-03-03T16:56:42.709ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5042026-03-03T16:56:42.709ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5052026-03-03T16:56:42.709ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5062026-03-03T16:56:42.709ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5072026-03-03T16:56:42.716ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5082026-03-03T16:56:42.716ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5092026-03-03T16:56:42.717ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5102026-03-03T16:56:42.718ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
5112026-03-03T16:56:42.718ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5122026-03-03T16:56:42.718ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5132026-03-03T16:56:42.718ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5142026-03-03T16:56:42.719ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5152026-03-03T16:56:42.720ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5162026-03-03T16:56:42.720ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5172026-03-03T16:56:42.720ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5182026-03-03T16:56:42.720ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5192026-03-03T16:56:42.723ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5202026-03-03T16:56:42.723ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5212026-03-03T16:56:42.723ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5222026-03-03T16:56:42.723ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5232026-03-03T16:56:42.725ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5242026-03-03T16:56:42.730ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5252026-03-03T16:56:42.733ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
5262026-03-03T16:56:42.733ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5272026-03-03T16:56:42.733ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5282026-03-03T16:56:42.733ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5292026-03-03T16:56:42.733ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5302026-03-03T16:56:42.736ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5312026-03-03T16:56:42.736ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5322026-03-03T16:56:42.736ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5332026-03-03T16:56:42.736ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5342026-03-03T16:56:42.738ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5352026-03-03T16:56:42.738ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5362026-03-03T16:56:42.738ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5372026-03-03T16:56:42.739ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5382026-03-03T16:56:42.740ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5392026-03-03T16:56:42.745ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5402026-03-03T16:56:42.745ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5412026-03-03T16:56:42.745ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5422026-03-03T16:56:42.745ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5432026-03-03T16:56:42.749ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5442026-03-03T16:56:42.749ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5452026-03-03T16:56:42.750ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5462026-03-03T16:56:42.758ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
5472026-03-03T16:56:42.758ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5482026-03-03T16:56:42.758ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5492026-03-03T16:56:42.758ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5502026-03-03T16:56:42.758ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5512026-03-03T16:56:42.758ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5522026-03-03T16:56:42.758ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5532026-03-03T16:56:42.758ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5542026-03-03T16:56:42.759ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5552026-03-03T16:56:42.760ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5562026-03-03T16:56:42.760ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5572026-03-03T16:56:42.760ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5582026-03-03T16:56:42.760ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5592026-03-03T16:56:42.761ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5602026-03-03T16:56:42.765ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5612026-03-03T16:56:42.767ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
5622026-03-03T16:56:42.767ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5632026-03-03T16:56:42.767ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5642026-03-03T16:56:42.767ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5652026-03-03T16:56:42.768ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5662026-03-03T16:56:42.771ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5672026-03-03T16:56:42.771ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5682026-03-03T16:56:42.771ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5692026-03-03T16:56:42.771ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5702026-03-03T16:56:42.771ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5712026-03-03T16:56:42.771ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5722026-03-03T16:56:42.771ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5732026-03-03T16:56:42.771ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5742026-03-03T16:56:42.772ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5752026-03-03T16:56:42.780ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5762026-03-03T16:56:42.780ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5772026-03-03T16:56:42.780ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5782026-03-03T16:56:42.780ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5792026-03-03T16:56:42.782ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5802026-03-03T16:56:42.782ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5812026-03-03T16:56:42.783ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5822026-03-03T16:56:42.784ZINFOtest_metrics (DataLoader): created built-in services vpc subnets
5832026-03-03T16:56:42.784ZINFOtest_metrics (DataLoader): created built-in services vpc
5842026-03-03T16:56:42.784ZTRACtest_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5852026-03-03T16:56:42.784ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5862026-03-03T16:56:42.790ZDEBGtest_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5872026-03-03T16:56:42.790ZDEBGtest_metrics (DataLoader): attempting to create silo users
5882026-03-03T16:56:42.790ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5892026-03-03T16:56:42.790ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5902026-03-03T16:56:42.790ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5912026-03-03T16:56:42.835ZINFOtest_metrics (DataLoader): created 2 silo users
5922026-03-03T16:56:42.836ZDEBGtest_metrics (DataLoader): attempting to create silo user role assignments
5932026-03-03T16:56:42.836ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5942026-03-03T16:56:42.836ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5952026-03-03T16:56:42.836ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5962026-03-03T16:56:42.839ZINFOtest_metrics (DataLoader): created 2 silo user role assignments
5972026-03-03T16:56:42.839ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5982026-03-03T16:56:42.839ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5992026-03-03T16:56:42.839ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6002026-03-03T16:56:42.842ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6012026-03-03T16:56:42.842ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6022026-03-03T16:56:42.842ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6032026-03-03T16:56:42.846ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList
6042026-03-03T16:56:42.846ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6052026-03-03T16:56:42.846ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6062026-03-03T16:56:42.846ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6072026-03-03T16:56:42.846ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6082026-03-03T16:56:42.847ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6092026-03-03T16:56:42.849ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList result = Ok(())
6102026-03-03T16:56:42.849ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6112026-03-03T16:56:42.849ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6122026-03-03T16:56:42.849ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6132026-03-03T16:56:42.938ZTRACtest_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList
6142026-03-03T16:56:42.938ZTRACtest_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6152026-03-03T16:56:42.938ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6162026-03-03T16:56:42.938ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6172026-03-03T16:56:42.939ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6182026-03-03T16:56:42.940ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6192026-03-03T16:56:42.942ZDEBGtest_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList result = Ok(())
6202026-03-03T16:56:42.942ZTRACtest_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6212026-03-03T16:56:42.942ZDEBGtest_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6222026-03-03T16:56:42.942ZDEBGtest_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6232026-03-03T16:56:42.944ZINFOtest_metrics (nexus): populate complete
6242026-03-03T16:56:42.944ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig
6252026-03-03T16:56:42.944ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6262026-03-03T16:56:42.944ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
6272026-03-03T16:56:42.944ZDEBGtest_metrics (BackgroundTasks): roles roles = RoleSet { roles: {} }
6282026-03-03T16:56:42.944ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
6292026-03-03T16:56:42.955ZDEBGtest_metrics (init_with_steps): Running step start_gateway_switch0
6302026-03-03T16:56:42.956ZDEBGtest_metrics: Starting Management Gateway
6312026-03-03T16:56:42.988ZDEBGtest_metrics (BackgroundTasks): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6322026-03-03T16:56:42.991ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig result = Ok(())
6332026-03-03T16:56:42.991ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
6342026-03-03T16:56:42.991ZDEBGtest_metrics (BackgroundTasks): roles roles = RoleSet { roles: {} }
6352026-03-03T16:56:42.992ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
6362026-03-03T16:56:42.995ZINFOtest_metrics (nexus): activating background tasks
6372026-03-03T16:56:42.998ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
6382026-03-03T16:56:42.998ZDEBGtest_metrics (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
6392026-03-03T16:56:42.998ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
6402026-03-03T16:56:42.998ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6412026-03-03T16:56:42.999ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6422026-03-03T16:56:43.000ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
6432026-03-03T16:56:43.000ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal
6442026-03-03T16:56:43.000ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
6452026-03-03T16:56:43.000ZWARNtest_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal reason = no config nor servers
6462026-03-03T16:56:43.000ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 44.37\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
6472026-03-03T16:56:43.000ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
6482026-03-03T16:56:43.000ZDEBGtest_metrics (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
6492026-03-03T16:56:43.000ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
6502026-03-03T16:56:43.000ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6512026-03-03T16:56:43.001ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6522026-03-03T16:56:43.001ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
6532026-03-03T16:56:43.001ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal
6542026-03-03T16:56:43.001ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
6552026-03-03T16:56:43.001ZWARNtest_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external reason = no config nor servers
6562026-03-03T16:56:43.001ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 43.95\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
6572026-03-03T16:56:43.006ZDEBGtest_metrics (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
6582026-03-03T16:56:43.006ZINFOtest_metrics (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-03-03 16:46:43.006412246 UTC
6592026-03-03T16:56:43.006ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database
6602026-03-03T16:56:43.006ZDEBGtest_metrics (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
6612026-03-03T16:56:43.007ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
6622026-03-03T16:56:43.007ZDEBGtest_metrics (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
6632026-03-03T16:56:43.007ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet
6642026-03-03T16:56:43.007ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6652026-03-03T16:56:43.007ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
6662026-03-03T16:56:43.007ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6672026-03-03T16:56:43.008ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
6682026-03-03T16:56:43.009ZDEBGtest_metrics (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 1 reason = Timeout
6692026-03-03T16:56:43.009ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database
6702026-03-03T16:56:43.009ZDEBGtest_metrics (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
6712026-03-03T16:56:43.009ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
6722026-03-03T16:56:43.009ZDEBGtest_metrics (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
6732026-03-03T16:56:43.009ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database
6742026-03-03T16:56:43.009ZDEBGtest_metrics (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6752026-03-03T16:56:43.010ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database result = Ok(())
6762026-03-03T16:56:43.010ZDEBGtest_metrics (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
6772026-03-03T16:56:43.010ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
6782026-03-03T16:56:43.010ZWARNtest_metrics (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor reason = no blueprint
6792026-03-03T16:56:43.010ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 29.94\u{b5}s iteration = 1 status = {"error":"no blueprint"}
6802026-03-03T16:56:43.010ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
6812026-03-03T16:56:43.010ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
6822026-03-03T16:56:43.010ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6832026-03-03T16:56:43.010ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
6842026-03-03T16:56:43.010ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6852026-03-03T16:56:43.011ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
6862026-03-03T16:56:43.011ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 1 reason = Timeout
6872026-03-03T16:56:43.011ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
6882026-03-03T16:56:43.011ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6892026-03-03T16:56:43.011ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
6902026-03-03T16:56:43.011ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
6912026-03-03T16:56:43.011ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
6922026-03-03T16:56:43.012ZDEBGtest_metrics (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 1 reason = Timeout
6932026-03-03T16:56:43.012ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig
6942026-03-03T16:56:43.012ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = reconfigurator_config_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6952026-03-03T16:56:43.012ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
6962026-03-03T16:56:43.012ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
6972026-03-03T16:56:43.012ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
6982026-03-03T16:56:43.014ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 1 reason = Timeout
6992026-03-03T16:56:43.014ZDEBGtest_metrics (BackgroundTasks): reconfigurator config not yet loaded; doing nothing background_task = blueprint_planner
7002026-03-03T16:56:43.014ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 29.98\u{b5}s iteration = 1 status = "Disabled"
7012026-03-03T16:56:43.014ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
7022026-03-03T16:56:43.014ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig
7032026-03-03T16:56:43.014ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7042026-03-03T16:56:43.014ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
7052026-03-03T16:56:43.014ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7062026-03-03T16:56:43.015ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
7072026-03-03T16:56:43.016ZDEBGtest_metrics (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
7082026-03-03T16:56:43.016ZWARNtest_metrics (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector reason = no blueprint
7092026-03-03T16:56:43.016ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 36.87\u{b5}s iteration = 1 status = {"error":"no blueprint"}
7102026-03-03T16:56:43.016ZDEBGtest_metrics (BackgroundTasks): activating background_task = support_bundle_collector iteration = 1 reason = Timeout
7112026-03-03T16:56:43.016ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet
7122026-03-03T16:56:43.016ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = support_bundle_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7132026-03-03T16:56:43.016ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
7142026-03-03T16:56:43.016ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7152026-03-03T16:56:43.016ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7162026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
7172026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.97\u{b5}s iteration = 1 status = {"error":"task disabled"}
7182026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 1 reason = Timeout
7192026-03-03T16:56:43.017ZWARNtest_metrics (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous reason = no blueprint
7202026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 11.82\u{b5}s iteration = 1 status = {"error":"no blueprint"}
7212026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
7222026-03-03T16:56:43.017ZINFOtest_metrics (BackgroundTasks): Decommissioned Disk Cleaner disabled background_task = decommissioned_disk_cleaner
7232026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 15.84\u{b5}s iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7242026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
7252026-03-03T16:56:43.017ZWARNtest_metrics (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker
7262026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 10.86\u{b5}s iteration = 1 status = {"error":"inventory collection is None"}
7272026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
7282026-03-03T16:56:43.017ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet
7292026-03-03T16:56:43.017ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = switch_port_config_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7302026-03-03T16:56:43.017ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database
7312026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7322026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7332026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
7342026-03-03T16:56:43.017ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
7352026-03-03T16:56:43.017ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7362026-03-03T16:56:43.018ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
7372026-03-03T16:56:43.018ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
7382026-03-03T16:56:43.018ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database
7392026-03-03T16:56:43.018ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7402026-03-03T16:56:43.018ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
7412026-03-03T16:56:43.018ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
7422026-03-03T16:56:43.018ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database
7432026-03-03T16:56:43.018ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7442026-03-03T16:56:43.019ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7452026-03-03T16:56:43.019ZDEBGtest_metrics (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
7462026-03-03T16:56:43.019ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet
7472026-03-03T16:56:43.019ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = instance_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7482026-03-03T16:56:43.019ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database
7492026-03-03T16:56:43.019ZDEBGtest_metrics (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7502026-03-03T16:56:43.019ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
7512026-03-03T16:56:43.019ZDEBGtest_metrics (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
7522026-03-03T16:56:43.019ZINFOtest_metrics (BackgroundTasks): background instance updater explicitly disabled background_task = instance_updater
7532026-03-03T16:56:43.019ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.95\u{b5}s iteration = 1 status = {"destroyed_active_vmms":0,"disabled":true,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7542026-03-03T16:56:43.019ZDEBGtest_metrics (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
7552026-03-03T16:56:43.019ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database
7562026-03-03T16:56:43.019ZDEBGtest_metrics (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7572026-03-03T16:56:43.020ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7582026-03-03T16:56:43.021ZDEBGtest_metrics (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
7592026-03-03T16:56:43.021ZDEBGtest_metrics (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
7602026-03-03T16:56:43.021ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
7612026-03-03T16:56:43.021ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622026-03-03T16:56:43.021ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632026-03-03T16:56:43.021ZDEBGtest_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
7642026-03-03T16:56:43.021ZINFOtest_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
7652026-03-03T16:56:43.021ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
7662026-03-03T16:56:43.021ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7672026-03-03T16:56:43.021ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
7682026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7692026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
7712026-03-03T16:56:43.022ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database
7722026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
7732026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
7742026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
7752026-03-03T16:56:43.022ZINFOtest_metrics (SagaQuiesceHandle): saga recovery pass starting
7762026-03-03T16:56:43.022ZDEBGtest_metrics (SagaRecoverer): listing candidate sagas for recovery
7772026-03-03T16:56:43.022ZTRACtest_metrics (SagaRecoverer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a (built_in_user), .. }) resource = Database
7782026-03-03T16:56:43.022ZDEBGtest_metrics (SagaRecoverer): roles roles = RoleSet { roles: {} }
7792026-03-03T16:56:43.022ZDEBGtest_metrics (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a (built_in_user), .. }) resource = Database result = Ok(())
7802026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
7812026-03-03T16:56:43.022ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database
7822026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
7832026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
7842026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
7852026-03-03T16:56:43.022ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database
7862026-03-03T16:56:43.022ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7872026-03-03T16:56:43.023ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7882026-03-03T16:56:43.023ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
7892026-03-03T16:56:43.023ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database
7902026-03-03T16:56:43.023ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7912026-03-03T16:56:43.023ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7922026-03-03T16:56:43.023ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
7932026-03-03T16:56:43.023ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database
7942026-03-03T16:56:43.023ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7952026-03-03T16:56:43.024ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7962026-03-03T16:56:43.025ZDEBGtest_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
7972026-03-03T16:56:43.025ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database
7982026-03-03T16:56:43.025ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7992026-03-03T16:56:43.025ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8002026-03-03T16:56:43.025ZDEBGtest_metrics (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 1 reason = Timeout
8012026-03-03T16:56:43.025ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
8022026-03-03T16:56:43.025ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8032026-03-03T16:56:43.025ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
8042026-03-03T16:56:43.025ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
8052026-03-03T16:56:43.025ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
8062026-03-03T16:56:43.025ZDEBGtest_metrics (BackgroundTasks): activating background_task = tuf_repo_pruner iteration = 1 reason = Timeout
8072026-03-03T16:56:43.025ZINFOtest_metrics (BackgroundTasks): reconfigurator config not yet loaded; doing nothing background_task = tuf_repo_pruner
8082026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = tuf_repo_pruner elapsed = 32.15\u{b5}s iteration = 1 status = {"reason":"reconfigurator config not yet loaded","status":"disabled"}
8092026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 1 reason = Timeout
8102026-03-03T16:56:43.026ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database
8112026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
8122026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
8132026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): activating background_task = alert_dispatcher iteration = 1 reason = Timeout
8142026-03-03T16:56:43.026ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database
8152026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
8162026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
8172026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): activating background_task = webhook_deliverator iteration = 1 reason = Timeout
8182026-03-03T16:56:43.026ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database
8192026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
8202026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
8212026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 1 reason = Timeout
8222026-03-03T16:56:43.026ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
8232026-03-03T16:56:43.026ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
8242026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): skipping cache invalidation check: no inventory available background_task = multicast_reconciler
8252026-03-03T16:56:43.026ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8262026-03-03T16:56:43.026ZDEBGtest_metrics (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 1 reason = Timeout
8272026-03-03T16:56:43.027ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
8282026-03-03T16:56:43.027ZDEBGtest_metrics (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 1 reason = Timeout
8292026-03-03T16:56:43.027ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet
8302026-03-03T16:56:43.027ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = fm_sitrep_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8312026-03-03T16:56:43.027ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database
8322026-03-03T16:56:43.027ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
8332026-03-03T16:56:43.027ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
8342026-03-03T16:56:43.027ZDEBGtest_metrics (BackgroundTasks): activating background_task = fm_sitrep_gc iteration = 1 reason = Timeout
8352026-03-03T16:56:43.027ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
8362026-03-03T16:56:43.027ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
8372026-03-03T16:56:43.027ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
8382026-03-03T16:56:43.028ZDEBGtest_metrics (BackgroundTasks): activating background_task = probe_distributor iteration = 1 reason = Timeout
8392026-03-03T16:56:43.028ZINFOtest_metrics (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor
8402026-03-03T16:56:43.028ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet
8412026-03-03T16:56:43.028ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = probe_distributor resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8422026-03-03T16:56:43.028ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
8432026-03-03T16:56:43.028ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
8442026-03-03T16:56:43.028ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
8452026-03-03T16:56:43.029ZDEBGtest_metrics (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 1 reason = Timeout
8462026-03-03T16:56:43.030ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet
8472026-03-03T16:56:43.030ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = trust_quorum_manager bgtask = TrustQuorumManager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8482026-03-03T16:56:43.030ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database
8492026-03-03T16:56:43.030ZDEBGtest_metrics (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
8502026-03-03T16:56:43.030ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
8512026-03-03T16:56:43.030ZDEBGtest_metrics (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 1 reason = Timeout
8522026-03-03T16:56:43.030ZINFOtest_metrics (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager
8532026-03-03T16:56:43.030ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8542026-03-03T16:56:43.030ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
8552026-03-03T16:56:43.030ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8562026-03-03T16:56:43.030ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
8572026-03-03T16:56:43.030ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8582026-03-03T16:56:43.030ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8592026-03-03T16:56:43.031ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
8602026-03-03T16:56:43.032ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8612026-03-03T16:56:43.032ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
8622026-03-03T16:56:43.032ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8632026-03-03T16:56:43.032ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8642026-03-03T16:56:43.033ZTRACtest_metrics (dns): buffer buffer = Length: 75 (0x4b) bytes\n0000: c0 93 01 00 00 01 00 00 00 00 00 01 0c 5f 6e 61 ............._na\n0010: 6d 65 73 65 72 76 69 63 65 04 5f 74 63 70 0d 63 meservice._tcp.c\n0020: 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 ontrol-plane.oxi\n0030: 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 de.internal..!..\n0040: 00 00 29 04 d0 00 00 00 00 00 00 ..)........ kind = dns peer_addr = [::1]:62736 req_id = f54de774-f6dd-4cb0-a1ee-6d52225a0f25
8652026-03-03T16:56:43.034ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 49299,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_nameservice._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_nameservice._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 12,\n 95,\n 110,\n 97,\n 109,\n 101,\n 115,\n 101,\n 114,\n 118,\n 105,\n 99,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:62736 req_id = f54de774-f6dd-4cb0-a1ee-6d52225a0f25
8662026-03-03T16:56:43.034ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49299, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nameservice._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 12, 95, 110, 97, 109, 101, 115, 101, 114, 118, 105, 99, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nameservice._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:62736 req_id = f54de774-f6dd-4cb0-a1ee-6d52225a0f25
8672026-03-03T16:56:43.034ZTRACtest_metrics (dns): buffer buffer = Length: 76 (0x4c) bytes\n0000: ad d1 01 00 00 01 00 00 00 00 00 01 0d 5f 65 78 ............._ex\n0010: 74 65 72 6e 61 6c 2d 64 6e 73 04 5f 74 63 70 0d ternal-dns._tcp.\n0020: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0030: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 ide.internal..!.\n0040: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:22530 req_id = 65876a22-b24a-4ef3-aa46-9f9b8faff3f7
8682026-03-03T16:56:43.034ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 44497,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_external-dns._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_external-dns._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 13,\n 95,\n 101,\n 120,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 45,\n 100,\n 110,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:22530 req_id = 65876a22-b24a-4ef3-aa46-9f9b8faff3f7
8692026-03-03T16:56:43.034ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44497, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_external-dns._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 13, 95, 101, 120, 116, 101, 114, 110, 97, 108, 45, 100, 110, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_external-dns._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:22530 req_id = 65876a22-b24a-4ef3-aa46-9f9b8faff3f7
8702026-03-03T16:56:43.034ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 0b 51 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .Q..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:47345 req_id = 967f70e0-8420-485b-8f50-ed164d048a91
8712026-03-03T16:56:43.034ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 2897,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:47345 req_id = 967f70e0-8420-485b-8f50-ed164d048a91
8722026-03-03T16:56:43.034ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 2897, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:47345 req_id = 967f70e0-8420-485b-8f50-ed164d048a91
8732026-03-03T16:56:43.034ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 26 cb 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 &............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:30580 req_id = 1d9af803-4b20-4265-abc2-50903a05d7cb
8742026-03-03T16:56:43.034ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 9931,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:30580 req_id = 1d9af803-4b20-4265-abc2-50903a05d7cb
8752026-03-03T16:56:43.034ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9931, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:30580 req_id = 1d9af803-4b20-4265-abc2-50903a05d7cb
8762026-03-03T16:56:43.034ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 7b 8a 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 {............_de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:27240 req_id = 1e9a72b7-f667-4be2-b813-491b81558b1e
8772026-03-03T16:56:43.034ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 31626,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:27240 req_id = 1e9a72b7-f667-4be2-b813-491b81558b1e
8782026-03-03T16:56:43.034ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 31626, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:27240 req_id = 1e9a72b7-f667-4be2-b813-491b81558b1e
8792026-03-03T16:56:43.035ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = multicast_reconciler error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8802026-03-03T16:56:43.035ZERROtest_metrics (BackgroundTasks): failed to build DPD clients background_task = multicast_reconciler error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8812026-03-03T16:56:43.035ZERROtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed with dataplane inconsistencies active_groups_verified = 0 background_task = multicast_reconciler dataplane_error_count = 1 external_groups_created = 0 external_groups_deleted = 0 member_state_transitions = 0 orphaned_members_cleaned = 0
8822026-03-03T16:56:43.035ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 8.351094ms iteration = 1 status = {"disabled":false,"empty_groups_marked":0,"errors":["failed to create multicast dataplane client: Internal Error: failed to build DPD clients"],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
8832026-03-03T16:56:43.035ZERROtest_metrics (BackgroundTasks): failed to resolve MGS addresses background_task = sp_ereport_ingester error = Resolve(ResolveError { kind: Proto(ProtoError { kind: NoRecordsFound { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, soa: None, ns: None, negative_ttl: None, response_code: ServFail, trusted: true, authorities: None } }) })
8842026-03-03T16:56:43.035ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 8.293654ms iteration = 1 status = {"disabled":false,"errors":["failed to resolve MGS addresses: proto error: no records found for Query { name: Name(\\"_mgs._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"],"sps":[]}
8852026-03-03T16:56:43.035ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = attached_subnet_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8862026-03-03T16:56:43.035ZERROtest_metrics (BackgroundTasks): failed to lookup Dendrite clients, will not be able to forward attachments to Dendrite background_task = attached_subnet_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8872026-03-03T16:56:43.035ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database
8882026-03-03T16:56:43.035ZDEBGtest_metrics (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
8892026-03-03T16:56:43.035ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
8902026-03-03T16:56:43.036ZWARNtest_metrics (BackgroundTasks): failed to lookup DNS servers background_task = dns_servers_internal dns_group = internal error = proto error: no records found for Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8912026-03-03T16:56:43.036ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 35.733157ms iteration = 1 status = {"error":"failed to read list of DNS servers: proto error: no records found for Query { name: Name(\\"_nameservice._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
8922026-03-03T16:56:43.036ZWARNtest_metrics (BackgroundTasks): failed to lookup DNS servers background_task = dns_servers_external dns_group = external error = proto error: no records found for Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8932026-03-03T16:56:43.036ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 34.515455ms iteration = 1 status = {"error":"failed to read list of DNS servers: proto error: no records found for Query { name: Name(\\"_external-dns._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
8942026-03-03T16:56:43.048ZINFOtest_metrics (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-03-03 16:46:43.006412246 UTC pruned = {}
8952026-03-03T16:56:43.048ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 41.699636ms iteration = 1 status = {"expiration":"2026-03-03T16:46:43.006412246Z","pruned":[]}
8962026-03-03T16:56:43.053ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8972026-03-03T16:56:43.057ZTRACtest_metrics (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8982026-03-03T16:56:43.057ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 8a a6 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:24669 req_id = b018bc75-1975-4d6b-aad5-a25a9a2e60f1
8992026-03-03T16:56:43.057ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 35494,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:24669 req_id = b018bc75-1975-4d6b-aad5-a25a9a2e60f1
9002026-03-03T16:56:43.061ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35494, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:24669 req_id = b018bc75-1975-4d6b-aad5-a25a9a2e60f1
9012026-03-03T16:56:43.061ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = nat_garbage_collector error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9022026-03-03T16:56:43.061ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = nat_garbage_collector error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9032026-03-03T16:56:43.061ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 48.898938ms iteration = 1 status = {"error":"failed to resolve addresses for Dendrite services: proto error: no records found for Query { name: Name(\\"_dendrite._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
9042026-03-03T16:56:43.061ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 9b ff 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:9974 req_id = cf5f160f-6818-4af4-a5a8-2ac75263adfc
9052026-03-03T16:56:43.061ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 39935,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:9974 req_id = cf5f160f-6818-4af4-a5a8-2ac75263adfc
9062026-03-03T16:56:43.061ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39935, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:9974 req_id = cf5f160f-6818-4af4-a5a8-2ac75263adfc
9072026-03-03T16:56:43.061ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = bfd_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9082026-03-03T16:56:43.061ZERROtest_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = bfd_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9092026-03-03T16:56:43.061ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 50.748831ms iteration = 1 status = {"error":"failed to resolve addresses for Dendrite services: proto error: no records found for Query { name: Name(\\"_dendrite._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
9102026-03-03T16:56:43.061ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 51.073341ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9112026-03-03T16:56:43.097ZDEBGtest_metrics (init_with_steps): Running step start_dendrite_switch0
9122026-03-03T16:56:43.097ZDEBGtest_metrics: Starting Dendrite for switch0
9132026-03-03T16:56:43.100ZDEBGtest_metrics (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9142026-03-03T16:56:43.103ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9152026-03-03T16:56:43.103ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database
9162026-03-03T16:56:43.103ZDEBGtest_metrics (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9172026-03-03T16:56:43.103ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9182026-03-03T16:56:43.111ZDEBGtest_metrics (init_with_steps): Running step start_mgd_switch0
9192026-03-03T16:56:43.111ZDEBGtest_metrics: Starting mgd for switch0
9202026-03-03T16:56:43.160ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:46333 remote_addr = 127.0.0.1:45742
9212026-03-03T16:56:43.161ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9222026-03-03T16:56:43.165ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9232026-03-03T16:56:43.165ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
9242026-03-03T16:56:43.165ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9252026-03-03T16:56:43.165ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
9262026-03-03T16:56:43.165ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9272026-03-03T16:56:43.174ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
9282026-03-03T16:56:43.174ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
9292026-03-03T16:56:43.174ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9302026-03-03T16:56:43.174ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
9312026-03-03T16:56:43.180ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9322026-03-03T16:56:43.189ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
9332026-03-03T16:56:43.189ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
9342026-03-03T16:56:43.189ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
9352026-03-03T16:56:43.189ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
9362026-03-03T16:56:43.191ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45742 req_id = 9dfea45d-d3b7-47e0-ba7e-dc2d290f76ec uri = /nat/ipv4/changeset/0?limit=100
9372026-03-03T16:56:43.191ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45742 req_id = 9dfea45d-d3b7-47e0-ba7e-dc2d290f76ec uri = /nat/ipv4/changeset/0?limit=100 version = 1.0.0
9382026-03-03T16:56:43.191ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45742 req_id = 9dfea45d-d3b7-47e0-ba7e-dc2d290f76ec resource = Database type = user_builtin uri = /nat/ipv4/changeset/0?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
9392026-03-03T16:56:43.191ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45742 req_id = 9dfea45d-d3b7-47e0-ba7e-dc2d290f76ec roles = RoleSet { roles: {} } type = user_builtin uri = /nat/ipv4/changeset/0?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
9402026-03-03T16:56:43.192ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45742 req_id = 9dfea45d-d3b7-47e0-ba7e-dc2d290f76ec resource = Database result = Ok(()) type = user_builtin uri = /nat/ipv4/changeset/0?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
9412026-03-03T16:56:43.196ZDEBGtest_metrics: mgd port is 34605
9422026-03-03T16:56:43.197ZDEBGtest_metrics (init_with_steps): Running step record_switch_dns
9432026-03-03T16:56:43.197ZDEBGtest_metrics: Recording DNS for the switch zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 switch_location = switch0
9442026-03-03T16:56:43.197ZDEBGtest_metrics (init_with_steps): Running step start_sled1
9452026-03-03T16:56:43.197ZINFOtest_metrics (omicron_sled_agent::sim::Server): setting up sled agent server sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9462026-03-03T16:56:43.231ZINFOtest_metrics (SledAgent): created simulated sled agent server = b6d65341-167c-41df-9b5c-41cded99c229 sim_mode = Explicit sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9472026-03-03T16:56:43.231ZINFOtest_metrics (omicron_sled_agent::sim::SimulatedUpstairs): registered sled b6d65341-167c-41df-9b5c-41cded99c229 storage
9482026-03-03T16:56:43.235ZINFOtest_metrics (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpGwNRNY/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9492026-03-03T16:56:43.235ZDEBGtest_metrics (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpGwNRNY/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9502026-03-03T16:56:43.235ZINFOtest_metrics (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpRZa5Rm/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9512026-03-03T16:56:43.235ZDEBGtest_metrics (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpRZa5Rm/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9522026-03-03T16:56:43.266ZDEBGtest_metrics (dropshot (Repo Depot)): registered endpoint local_addr = [::1]:33671 method = GET path = /artifact/sha256/{sha256} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9532026-03-03T16:56:43.266ZINFOtest_metrics (dropshot (Repo Depot)): listening local_addr = [::1]:33671 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9542026-03-03T16:56:43.266ZDEBGtest_metrics (dropshot (Repo Depot)): successfully registered DTrace USDT probes local_addr = [::1]:33671 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9552026-03-03T16:56:43.268ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /artifacts sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9562026-03-03T16:56:43.268ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /artifacts/{sha256} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9572026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /artifacts/{sha256}/copy-from-depot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9582026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /artifacts-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9592026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /artifacts-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9602026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /bootstore/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9612026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /chicken-switch/destroy-orphaned-datasets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 2.0.0
9622026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /chicken-switch/destroy-orphaned-datasets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 3.0.0
9632026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /debug/switch-zone-policy sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 3.0.0
9642026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /debug/switch-zone-policy sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 3.0.0
9652026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /disks/{disk_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 21.0.0
9662026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /eip-gateways sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9672026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 22.0.0
9682026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 16.0.0 to 22.0.0
9692026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 14.0.0 to 16.0.0
9702026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 12.0.0 to 14.0.0
9712026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 11.0.0 to 12.0.0
9722026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 10.0.0 to 11.0.0
9732026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 4.0.0 to 10.0.0
9742026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 4.0.0
9752026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = DELETE path = /local-storage sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 17.0.0
9762026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /local-storage sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 17.0.0
9772026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = DELETE path = /local-storage/{zpool_id}/{dataset_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 9.0.0 to 17.0.0
9782026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /local-storage/{zpool_id}/{dataset_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 9.0.0 to 17.0.0
9792026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 20.0.0 to 23.0.0
9802026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 20.0.0
9812026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 20.0.0
9822026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 20.0.0
9832026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 14.0.0
9842026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 11.0.0 to 14.0.0
9852026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 10.0.0 to 11.0.0
9862026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 4.0.0 to 10.0.0
9872026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 4.0.0
9882026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /probes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 10.0.0
9892026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /probes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 6.0.0 to 10.0.0
9902026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /rot/{rot}/attest sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 19.0.0
9912026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /rot/{rot}/certificate-chain sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 19.0.0
9922026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /rot/{rot}/measurement-log sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 19.0.0
9932026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /sled-identifiers sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9942026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /sled-role sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 8.0.0
9952026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /sleds sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9962026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/dladm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9972026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/health-check sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9982026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/ipadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9992026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/logs/download/{zone} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10002026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/logs/zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10012026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/nvmeadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10022026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/pargs-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10032026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/pfiles-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10042026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/pstack-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10052026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/zfs-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10062026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/zoneadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10072026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support/zpool-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10082026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support-bundles/{zpool_id}/{dataset_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10092026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = DELETE path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10102026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10112026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10122026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10132026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download/{file} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10142026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download/{file} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10152026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/finalize sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10162026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/index sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10172026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/index sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10182026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/transfer sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10192026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /switch-ports sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 20.0.0
10202026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /switch-ports sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 20.0.0
10212026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /trust-quorum/commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10222026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /trust-quorum/configuration sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10232026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /trust-quorum/coordinator-status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10242026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /trust-quorum/network-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 15.0.0
10252026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /trust-quorum/network-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 15.0.0
10262026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /trust-quorum/prepare-and-commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10272026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /trust-quorum/proxy/commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10282026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /trust-quorum/proxy/prepare-and-commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10292026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /trust-quorum/proxy/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10302026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /trust-quorum/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 15.0.0
10312026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /trust-quorum/upgrade sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10322026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = DELETE path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10332026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10342026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10352026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = DELETE path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10362026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10372026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 17.0.0 to 18.0.0
10382026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 11.0.0 to 17.0.0
10392026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 10.0.0 to 11.0.0
10402026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 9.0.0 to 10.0.0
10412026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 7.0.0 to 9.0.0
10422026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 7.0.0
10432026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = DELETE path = /vmms/{propolis_id}/attached-subnets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10442026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /vmms/{propolis_id}/attached-subnets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10452026-03-03T16:56:43.269ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id}/attached-subnets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10462026-03-03T16:56:43.270ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = DELETE path = /vmms/{propolis_id}/attached-subnets/{subnet} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10472026-03-03T16:56:43.270ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /vmms/{propolis_id}/disks/{disk_id}/snapshot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10482026-03-03T16:56:43.270ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = DELETE path = /vmms/{propolis_id}/external-ip sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10492026-03-03T16:56:43.270ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id}/external-ip sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10502026-03-03T16:56:43.270ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = DELETE path = /vmms/{propolis_id}/multicast-group sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 7.0.0
10512026-03-03T16:56:43.270ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id}/multicast-group sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 7.0.0
10522026-03-03T16:56:43.270ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /vmms/{propolis_id}/poke sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10532026-03-03T16:56:43.270ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /vmms/{propolis_id}/poke-single-step sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10542026-03-03T16:56:43.270ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /vmms/{propolis_id}/sim-migration-source sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10552026-03-03T16:56:43.298ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /vmms/{propolis_id}/state sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10562026-03-03T16:56:43.298ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vmms/{propolis_id}/state sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10572026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vpc/{vpc_id}/firewall/rules sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 10.0.0
10582026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vpc/{vpc_id}/firewall/rules sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 10.0.0
10592026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /vpc-routes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10602026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /vpc-routes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10612026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10622026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = POST path = /zones/bundle-cleanup sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10632026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /zones/bundle-cleanup/context sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10642026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = PUT path = /zones/bundle-cleanup/context sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10652026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /zones/bundle-cleanup/utilization sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10662026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /zones/bundles sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10672026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /zones/bundles/{zone_name} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10682026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = DELETE path = /zones/bundles/{zone_name}/{bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10692026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:33115 method = GET path = /zones/bundles/{zone_name}/{bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10702026-03-03T16:56:43.299ZINFOtest_metrics (dropshot): listening local_addr = [::1]:33115 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10712026-03-03T16:56:43.299ZDEBGtest_metrics (dropshot): successfully registered DTrace USDT probes local_addr = [::1]:33115 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10722026-03-03T16:56:43.300ZDEBGtest_metrics (omicron_sled_agent::sim::Server): contacting server nexus sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10732026-03-03T16:56:43.300ZDEBGtest_metrics (NexusClient): client request body = Some(Body) method = POST sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = http://127.0.0.1:46333/sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
10742026-03-03T16:56:43.300ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10752026-03-03T16:56:43.304ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
10762026-03-03T16:56:43.304ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
10772026-03-03T16:56:43.304ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
10782026-03-03T16:56:43.304ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
10792026-03-03T16:56:43.333ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
10802026-03-03T16:56:43.333ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10812026-03-03T16:56:43.333ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10822026-03-03T16:56:43.334ZDEBGtest_metrics (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10832026-03-03T16:56:43.337ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10842026-03-03T16:56:43.337ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database
10852026-03-03T16:56:43.337ZDEBGtest_metrics (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10862026-03-03T16:56:43.337ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
10872026-03-03T16:56:43.343ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10882026-03-03T16:56:43.346ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10892026-03-03T16:56:43.346ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
10902026-03-03T16:56:43.346ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10912026-03-03T16:56:43.383ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
10922026-03-03T16:56:43.385ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database
10932026-03-03T16:56:43.385ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10942026-03-03T16:56:43.385ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10952026-03-03T16:56:43.386ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962026-03-03T16:56:43.388ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10972026-03-03T16:56:43.388ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
10982026-03-03T16:56:43.388ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
10992026-03-03T16:56:43.388ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
11002026-03-03T16:56:43.388ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11012026-03-03T16:56:43.389ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11022026-03-03T16:56:43.401ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:46333 remote_addr = 127.0.0.1:45744
11032026-03-03T16:56:43.402ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 380.592685ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
11042026-03-03T16:56:43.403ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11052026-03-03T16:56:43.406ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11062026-03-03T16:56:43.406ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
11072026-03-03T16:56:43.406ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11082026-03-03T16:56:43.406ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11092026-03-03T16:56:43.407ZDEBGtest_metrics (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11102026-03-03T16:56:43.407ZINFOtest_metrics (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11112026-03-03T16:56:43.407ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 386.101144ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11122026-03-03T16:56:43.407ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database
11132026-03-03T16:56:43.407ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11142026-03-03T16:56:43.407ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
11152026-03-03T16:56:43.432ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45744 req_id = 183733fc-e49a-4354-9f00-ed769ebd6940 uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
11162026-03-03T16:56:43.432ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45744 req_id = 183733fc-e49a-4354-9f00-ed769ebd6940 uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229 version = 1.0.0
11172026-03-03T16:56:43.433ZINFOtest_metrics (nexus): registered sled agent sled_uuid = b6d65341-167c-41df-9b5c-41cded99c229
11182026-03-03T16:56:43.435ZWARNtest_metrics (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set
11192026-03-03T16:56:43.435ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 421.138779ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
11202026-03-03T16:56:43.455ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet
11212026-03-03T16:56:43.456ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = fm_sitrep_gc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11222026-03-03T16:56:43.456ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
11232026-03-03T16:56:43.456ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
11242026-03-03T16:56:43.456ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
11252026-03-03T16:56:43.457ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11262026-03-03T16:56:43.460ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
11272026-03-03T16:56:43.460ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
11282026-03-03T16:56:43.460ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11292026-03-03T16:56:43.460ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
11302026-03-03T16:56:43.460ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
11312026-03-03T16:56:43.461ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
11322026-03-03T16:56:43.461ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
11332026-03-03T16:56:43.462ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11342026-03-03T16:56:43.463ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
11352026-03-03T16:56:43.464ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11362026-03-03T16:56:43.470ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
11372026-03-03T16:56:43.470ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database
11382026-03-03T16:56:43.470ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
11392026-03-03T16:56:43.472ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
11402026-03-03T16:56:43.473ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412026-03-03T16:56:43.480ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
11422026-03-03T16:56:43.480ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet
11432026-03-03T16:56:43.480ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = probe_distributor resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11442026-03-03T16:56:43.480ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
11452026-03-03T16:56:43.480ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
11462026-03-03T16:56:43.480ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
11472026-03-03T16:56:43.481ZTRACtest_metrics (BackgroundTasks): no more instances in need of reincarnation background_task = instance_reincarnation reincarnation_reason = instance failed total_found = 0
11482026-03-03T16:56:43.481ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database
11492026-03-03T16:56:43.481ZDEBGtest_metrics (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11502026-03-03T16:56:43.481ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11512026-03-03T16:56:43.482ZINFOtest_metrics (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator num_receivers = 0
11522026-03-03T16:56:43.482ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 456.127866ms iteration = 1 status = {"by_rx":{},"error":null}
11532026-03-03T16:56:43.531ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database
11542026-03-03T16:56:43.531ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11552026-03-03T16:56:43.531ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11562026-03-03T16:56:43.531ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
11572026-03-03T16:56:43.531ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
11582026-03-03T16:56:43.531ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: b6 88 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:36788 req_id = 241de3ec-ff1c-414a-b614-cf9eaa9e04fc
11592026-03-03T16:56:43.531ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 46728,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:36788 req_id = 241de3ec-ff1c-414a-b614-cf9eaa9e04fc
11602026-03-03T16:56:43.531ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 46728, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:36788 req_id = 241de3ec-ff1c-414a-b614-cf9eaa9e04fc
11612026-03-03T16:56:43.531ZWARNtest_metrics (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: looking up MGS addresses: proto error: no records found for Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
11622026-03-03T16:56:43.531ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 521.210728ms iteration = 1 status = {"error":"failed to collect inventory: looking up MGS addresses: proto error: no records found for Query { name: Name(\\"_mgs._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
11632026-03-03T16:56:43.532ZINFOtest_metrics (SagaRecoverer): listed in-progress sagas count = 0
11642026-03-03T16:56:43.532ZINFOtest_metrics (SagaQuiesceHandle): saga recovery pass finished blueprint_id = None generation = 1
11652026-03-03T16:56:43.532ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 510.494492ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
11662026-03-03T16:56:43.532ZDEBGtest_metrics (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11672026-03-03T16:56:43.536ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
11682026-03-03T16:56:43.536ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database
11692026-03-03T16:56:43.536ZDEBGtest_metrics (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
11702026-03-03T16:56:43.536ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
11712026-03-03T16:56:43.537ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 520.214757ms iteration = 1 status = {}
11722026-03-03T16:56:43.561ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 546.763149ms iteration = 1 status = "NoCollections"
11732026-03-03T16:56:43.570ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 546.608289ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
11742026-03-03T16:56:43.590ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 562.481314ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
11752026-03-03T16:56:43.590ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
11762026-03-03T16:56:43.590ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11772026-03-03T16:56:43.590ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11782026-03-03T16:56:43.590ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig
11792026-03-03T16:56:43.590ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11802026-03-03T16:56:43.590ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
11812026-03-03T16:56:43.590ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11822026-03-03T16:56:43.590ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
11832026-03-03T16:56:43.591ZDEBGtest_metrics (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: false, planner_config: PlannerConfig { add_zones_with_mupdate_override: false }, tuf_repo_pruner_enabled: true }, time_modified: 2026-03-03T16:56:42.943994Z })
11842026-03-03T16:56:43.591ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 577.862398ms iteration = 1 status = {"config_updated":true}
11852026-03-03T16:56:43.591ZDEBGtest_metrics (BackgroundTasks): activating background_task = tuf_repo_pruner iteration = 2 reason = Dependency
11862026-03-03T16:56:43.591ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet
11872026-03-03T16:56:43.591ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_repo_pruner resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11882026-03-03T16:56:43.591ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
11892026-03-03T16:56:43.591ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
11902026-03-03T16:56:43.591ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
11912026-03-03T16:56:43.591ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 2 reason = Dependency
11922026-03-03T16:56:43.591ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
11932026-03-03T16:56:43.591ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 20.17\u{b5}s iteration = 2 status = "Disabled"
11942026-03-03T16:56:43.592ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11952026-03-03T16:56:43.595ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11962026-03-03T16:56:43.595ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
11972026-03-03T16:56:43.595ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11982026-03-03T16:56:43.595ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11992026-03-03T16:56:43.596ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database
12002026-03-03T16:56:43.596ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12012026-03-03T16:56:43.596ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12022026-03-03T16:56:43.596ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 571.629739ms iteration = 1 status = {"errors":[],"requests_created_ok":[]}
12032026-03-03T16:56:43.621ZINFOtest_metrics (dropshot_internal): request completed latency_us = 430529 local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45742 req_id = 9dfea45d-d3b7-47e0-ba7e-dc2d290f76ec response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12042026-03-03T16:56:43.636ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12052026-03-03T16:56:43.639ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
12062026-03-03T16:56:43.639ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
12072026-03-03T16:56:43.639ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
12082026-03-03T16:56:43.639ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
12092026-03-03T16:56:43.651ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12102026-03-03T16:56:43.656ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12112026-03-03T16:56:43.668ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 641.731931ms iteration = 1 status = "NoSitrep"
12122026-03-03T16:56:43.722ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132026-03-03T16:56:43.725ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
12142026-03-03T16:56:43.725ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
12152026-03-03T16:56:43.725ZDEBGtest_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
12162026-03-03T16:56:43.729ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
12172026-03-03T16:56:43.757ZINFOtest_metrics (BackgroundTasks): all instance checks complete background_task = instance_watcher pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12182026-03-03T16:56:43.757ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 738.072423ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12192026-03-03T16:56:43.760ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12202026-03-03T16:56:43.765ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12212026-03-03T16:56:43.768ZTRACtest_metrics (BackgroundTasks): reprocessing 0 outdated webhook globs... background_task = alert_dispatcher
12222026-03-03T16:56:43.768ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database
12232026-03-03T16:56:43.768ZDEBGtest_metrics (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
12242026-03-03T16:56:43.768ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
12252026-03-03T16:56:43.793ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_replacement elapsed = 774.579491ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12262026-03-03T16:56:43.811ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
12272026-03-03T16:56:43.811ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
12282026-03-03T16:56:43.811ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
12292026-03-03T16:56:43.811ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12302026-03-03T16:56:43.811ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12312026-03-03T16:56:43.821ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 803.183497ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12322026-03-03T16:56:43.823ZWARNtest_metrics (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0
12332026-03-03T16:56:43.823ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 822.630857ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
12342026-03-03T16:56:43.826ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12352026-03-03T16:56:43.838ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet result = Ok(())
12362026-03-03T16:56:43.902ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database
12372026-03-03T16:56:43.902ZDEBGtest_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12382026-03-03T16:56:43.902ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12392026-03-03T16:56:43.908ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
12402026-03-03T16:56:43.908ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
12412026-03-03T16:56:43.908ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
12422026-03-03T16:56:43.917ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12432026-03-03T16:56:43.917ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet result = Ok(())
12442026-03-03T16:56:43.917ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
12452026-03-03T16:56:43.917ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
12462026-03-03T16:56:43.917ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
12472026-03-03T16:56:43.917ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 892.582859ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12482026-03-03T16:56:43.917ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet
12492026-03-03T16:56:43.917ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = support_bundle_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12502026-03-03T16:56:43.917ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
12512026-03-03T16:56:43.917ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12522026-03-03T16:56:43.918ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12532026-03-03T16:56:43.933ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet
12542026-03-03T16:56:43.933ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = fm_sitrep_gc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12552026-03-03T16:56:43.933ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
12562026-03-03T16:56:43.933ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
12572026-03-03T16:56:43.934ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
12582026-03-03T16:56:44.006ZDEBGtest_metrics (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
12592026-03-03T16:56:44.006ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 976.515522ms iteration = 1 status = {"db_error":null,"dendrite":{},"sled":{}}
12602026-03-03T16:56:44.021ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12612026-03-03T16:56:44.024ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12622026-03-03T16:56:44.024ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
12632026-03-03T16:56:44.024ZDEBGtest_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12642026-03-03T16:56:44.024ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12652026-03-03T16:56:44.025ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
12662026-03-03T16:56:44.025ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
12672026-03-03T16:56:44.025ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12682026-03-03T16:56:44.026ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12692026-03-03T16:56:44.106ZDEBGtest_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12702026-03-03T16:56:44.108ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet result = Ok(())
12712026-03-03T16:56:44.112ZINFOtest_metrics (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager
12722026-03-03T16:56:44.112ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 1.083842733s iteration = 1 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
12732026-03-03T16:56:44.114ZTRACtest_metrics (BackgroundTasks): webhook dispatching completed successfully background_task = alert_dispatcher events_dispatched = 0 events_without_receivers = 0
12742026-03-03T16:56:44.115ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 1.089231112s iteration = 1 status = {"dispatched":[],"errors":[],"glob_version":"233.0.0","globs_reprocessed":{},"no_receivers":[]}
12752026-03-03T16:56:44.115ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet
12762026-03-03T16:56:44.115ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_repo_pruner resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12772026-03-03T16:56:44.115ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
12782026-03-03T16:56:44.115ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
12792026-03-03T16:56:44.115ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
12802026-03-03T16:56:44.116ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12812026-03-03T16:56:44.116ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
12822026-03-03T16:56:44.116ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12832026-03-03T16:56:44.117ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12842026-03-03T16:56:44.146ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
12852026-03-03T16:56:44.146ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12862026-03-03T16:56:44.146ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
12872026-03-03T16:56:44.147ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12882026-03-03T16:56:44.147ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
12892026-03-03T16:56:44.164ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 1.143234157s iteration = 1 status = {}
12902026-03-03T16:56:44.175ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12912026-03-03T16:56:44.178ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet result = Ok(())
12922026-03-03T16:56:44.178ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
12932026-03-03T16:56:44.178ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
12942026-03-03T16:56:44.179ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
12952026-03-03T16:56:44.182ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12962026-03-03T16:56:44.186ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12972026-03-03T16:56:44.186ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
12982026-03-03T16:56:44.186ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12992026-03-03T16:56:44.186ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
13002026-03-03T16:56:44.209ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = TargetReleaseConfig
13012026-03-03T16:56:44.209ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_repo_pruner resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13022026-03-03T16:56:44.209ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
13032026-03-03T16:56:44.209ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
13042026-03-03T16:56:44.210ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
13052026-03-03T16:56:44.211ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 1.187397428s iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
13062026-03-03T16:56:44.211ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13072026-03-03T16:56:44.216ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13082026-03-03T16:56:44.216ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "Vpc" using built-in user background_task = service_firewall_rule_propagation
13092026-03-03T16:56:44.216ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
13102026-03-03T16:56:44.216ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
13112026-03-03T16:56:44.216ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13122026-03-03T16:56:44.216ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13132026-03-03T16:56:44.217ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13142026-03-03T16:56:44.217ZWARNtest_metrics (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0
13152026-03-03T16:56:44.217ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 1.219315358s iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
13162026-03-03T16:56:44.222ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13172026-03-03T16:56:44.226ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = TargetReleaseConfig result = Ok(())
13182026-03-03T16:56:44.226ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
13192026-03-03T16:56:44.226ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
13202026-03-03T16:56:44.226ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
13212026-03-03T16:56:44.235ZINFOtest_metrics (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor n_pushed_probes = 0
13222026-03-03T16:56:44.235ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 1.20755899s iteration = 1 status = {"errors":[],"probes_by_sled":{}}
13232026-03-03T16:56:44.235ZDEBGtest_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Dependency
13242026-03-03T16:56:44.235ZINFOtest_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
13252026-03-03T16:56:44.235ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
13262026-03-03T16:56:44.236ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13272026-03-03T16:56:44.236ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
13282026-03-03T16:56:44.236ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13292026-03-03T16:56:44.236ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13302026-03-03T16:56:44.248ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
13312026-03-03T16:56:44.248ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13322026-03-03T16:56:44.248ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13332026-03-03T16:56:44.249ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13342026-03-03T16:56:44.276ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13352026-03-03T16:56:44.276ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13362026-03-03T16:56:44.276ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13372026-03-03T16:56:44.276ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13382026-03-03T16:56:44.277ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13392026-03-03T16:56:44.280ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13402026-03-03T16:56:44.280ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
13412026-03-03T16:56:44.280ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13422026-03-03T16:56:44.280ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
13432026-03-03T16:56:44.280ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13442026-03-03T16:56:44.280ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13452026-03-03T16:56:44.281ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
13462026-03-03T16:56:44.281ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13472026-03-03T16:56:44.281ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
13482026-03-03T16:56:44.281ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
13492026-03-03T16:56:44.281ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
13502026-03-03T16:56:44.283ZINFOtest_metrics (BackgroundTasks): No bundles to collect background_task = support_bundle_collector
13512026-03-03T16:56:44.285ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 1.267146195s iteration = 1 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
13522026-03-03T16:56:44.285ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13532026-03-03T16:56:44.290ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13542026-03-03T16:56:44.290ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
13552026-03-03T16:56:44.290ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13562026-03-03T16:56:44.291ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
13572026-03-03T16:56:44.291ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13582026-03-03T16:56:44.291ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
13592026-03-03T16:56:44.291ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13602026-03-03T16:56:44.300ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13612026-03-03T16:56:44.306ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
13622026-03-03T16:56:44.306ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13632026-03-03T16:56:44.315ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13642026-03-03T16:56:44.316ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13652026-03-03T16:56:44.322ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13662026-03-03T16:56:44.322ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13672026-03-03T16:56:44.322ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13682026-03-03T16:56:44.322ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13692026-03-03T16:56:44.323ZINFOtest_metrics (BackgroundTasks): tuf_repo_prune decision background_task = tuf_repo_pruner status = TufRepoPrunerDetails { nkeep_recent_releases: 3, nkeep_recent_uploads: 2, repos_keep_target_release: {}, repos_keep_recent_uploads: {}, repo_prune: None, other_repos_eligible_to_prune: {}, warnings: [] }
13702026-03-03T16:56:44.323ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = tuf_repo_pruner elapsed = 733.116595ms iteration = 2 status = {"nkeep_recent_releases":3,"nkeep_recent_uploads":2,"other_repos_eligible_to_prune":[],"repo_prune":null,"repos_keep_recent_uploads":[],"repos_keep_target_release":[],"status":"enabled","warnings":[]}
13712026-03-03T16:56:44.323ZINFOtest_metrics (BackgroundTasks): deleted 0 of 0 sitreps sitreps background_task = fm_sitrep_gc case_ereports_deleted = 0 cases_deleted = 0 ids = [] sitreps_deleted = 0
13722026-03-03T16:56:44.323ZTRACtest_metrics (BackgroundTasks): all 0 orphaned sitreps in this batch have already been deleted background_task = fm_sitrep_gc
13732026-03-03T16:56:44.323ZINFOtest_metrics (BackgroundTasks): sitrep garbage collection found 0 orphaned sitreps, deleted 0 background_task = fm_sitrep_gc
13742026-03-03T16:56:44.323ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = fm_sitrep_gc elapsed = 1.295949051s iteration = 1 status = {"errors":[],"orphaned_sitreps_deleted":0,"orphaned_sitreps_found":0}
13752026-03-03T16:56:44.323ZWARNtest_metrics (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone
13762026-03-03T16:56:44.323ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 1.316045043s iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
13772026-03-03T16:56:44.323ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
13782026-03-03T16:56:44.323ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
13792026-03-03T16:56:44.323ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13802026-03-03T16:56:44.323ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
13812026-03-03T16:56:44.323ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13822026-03-03T16:56:44.324ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
13832026-03-03T16:56:44.324ZINFOtest_metrics (dropshot_internal): request completed latency_us = 892732 local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45744 req_id = 183733fc-e49a-4354-9f00-ed769ebd6940 response_code = 204 uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
13842026-03-03T16:56:44.357ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13852026-03-03T16:56:44.360ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
13862026-03-03T16:56:44.360ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
13872026-03-03T16:56:44.360ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
13882026-03-03T16:56:44.360ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
13892026-03-03T16:56:44.361ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13902026-03-03T16:56:44.364ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13912026-03-03T16:56:44.364ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
13922026-03-03T16:56:44.364ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13932026-03-03T16:56:44.364ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
13942026-03-03T16:56:44.365ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13952026-03-03T16:56:44.369ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
13962026-03-03T16:56:44.369ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
13972026-03-03T16:56:44.369ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13982026-03-03T16:56:44.369ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
13992026-03-03T16:56:44.378ZTRACtest_metrics (BackgroundTasks): no more instances in need of reincarnation background_task = instance_reincarnation reincarnation_reason = start saga failed total_found = 0
14002026-03-03T16:56:44.378ZINFOtest_metrics (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
14012026-03-03T16:56:44.378ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 1.351194579s iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
14022026-03-03T16:56:44.378ZDEBGtest_metrics (NexusClient): client response result = Ok(Response { url: "http://127.0.0.1:46333/sled-agents/b6d65341-167c-41df-9b5c-41cded99c229", status: 204, headers: {"x-request-id": "183733fc-e49a-4354-9f00-ed769ebd6940", "date": "Tue, 03 Mar 2026 16:56:44 GMT"} }) sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14032026-03-03T16:56:44.378ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14042026-03-03T16:56:44.378ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14052026-03-03T16:56:44.378ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14062026-03-03T16:56:44.396ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
14072026-03-03T16:56:44.396ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14082026-03-03T16:56:44.396ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14092026-03-03T16:56:44.396ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14102026-03-03T16:56:44.397ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14112026-03-03T16:56:44.419ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = None method = GET uri = http://[::1]:33115/v2p
14122026-03-03T16:56:44.420ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14132026-03-03T16:56:44.420ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14142026-03-03T16:56:44.421ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14152026-03-03T16:56:44.421ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
14162026-03-03T16:56:44.421ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
14172026-03-03T16:56:44.424ZDEBGtest_metrics (init_with_steps): Running step configure_boundary_ntp
14182026-03-03T16:56:44.424ZDEBGtest_metrics (init_with_steps): Running step start_crucible_pantry
14192026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = GET path = /crucible/pantry/0 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14202026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = GET path = /crucible/pantry/0/job/{id}/is-finished sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14212026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = GET path = /crucible/pantry/0/job/{id}/ok sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14222026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = DELETE path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14232026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = GET path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14242026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = POST path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14252026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = POST path = /crucible/pantry/0/volume/{id}/background sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14262026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = POST path = /crucible/pantry/0/volume/{id}/bulk-write sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14272026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = POST path = /crucible/pantry/0/volume/{id}/import-from-url sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14282026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = POST path = /crucible/pantry/0/volume/{id}/scrub sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14292026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:44387 method = POST path = /crucible/pantry/0/volume/{id}/snapshot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
14302026-03-03T16:56:44.424ZINFOtest_metrics (dropshot): listening kind = pantry local_addr = [::1]:44387 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14312026-03-03T16:56:44.424ZDEBGtest_metrics (dropshot): successfully registered DTrace USDT probes kind = pantry local_addr = [::1]:44387 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14322026-03-03T16:56:44.424ZINFOtest_metrics (omicron_sled_agent::sim::Server): Started Simulated Crucible Pantry address = [::1]:44387 kind = pantry sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14332026-03-03T16:56:44.424ZDEBGtest_metrics (init_with_steps): Running step populate_internal_dns
14342026-03-03T16:56:44.424ZDEBGtest_metrics: Populating Internal DNS
14352026-03-03T16:56:44.436ZINFOtest_metrics: DNS population: DnsConfigParams { generation: Generation( 1, ), serial: 1, time_created: 2026-03-03T16:56:44.435944408Z, zones: [ DnsConfigZone { zone_name: "control-plane.oxide.internal", records: { "_clickhouse-native._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 9000, target: "6df52bac-061c-4570-b9a6-63f0031151c4.host.control-plane.oxide.internal", }, ), ], "_nameservice._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 43957, target: "5af26469-64ce-4f90-bbd5-93c35e3638d1.host.control-plane.oxide.internal", }, ), ], "_nexus-lockstep._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 32891, target: "913233fe-92a8-4635-9572-183f495429c4.host.control-plane.oxide.internal", }, ), ], "_clickhouse._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 37095, target: "6df52bac-061c-4570-b9a6-63f0031151c4.host.control-plane.oxide.internal", }, ), ], "boundary-ntp": [ Aaaa( ::1, ), ], "5af26469-64ce-4f90-bbd5-93c35e3638d1.host": [ Aaaa( ::1, ), ], "ns1": [ Aaaa( ::1, ), ], "_mgd._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 34605, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "5003bd5e-8cef-4ba6-a473-d7948135a715.host": [ Aaaa( ::1, ), ], "_cockroach._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 32943, target: "5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal", }, ), ], "_mgs._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 36753, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host": [ Aaaa( ::1, ), ], "_repo-depot._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 33671, target: "b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal", }, ), ], "_boundary-ntp._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 123, target: "00202f40-5fe9-436d-80ec-5125a4b6d9f1.host.control-plane.oxide.internal", }, ), ], "_external-dns._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 39361, target: "9f9be08c-87bc-4246-a3f7-f9772fad7223.host.control-plane.oxide.internal", }, ), ], "_crucible-pantry._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 44387, target: "79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host.control-plane.oxide.internal", }, ), ], "_oximeter-reader._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 9000, target: "6df52bac-061c-4570-b9a6-63f0031151c4.host.control-plane.oxide.internal", }, ), ], "913233fe-92a8-4635-9572-183f495429c4.host": [ Aaaa( ::ffff:127.0.0.1, ), ], "9f9be08c-87bc-4246-a3f7-f9772fad7223.host": [ Aaaa( ::1, ), ], "@": [ Ns( "ns1.control-plane.oxide.internal", ), ], "_nexus._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 46333, target: "913233fe-92a8-4635-9572-183f495429c4.host.control-plane.oxide.internal", }, ), ], "_dendrite._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 42205, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "00202f40-5fe9-436d-80ec-5125a4b6d9f1.host": [ Aaaa( ::1, ), ], "6df52bac-061c-4570-b9a6-63f0031151c4.host": [ Aaaa( ::1, ), ], "b6d65341-167c-41df-9b5c-41cded99c229.sled": [ Aaaa( ::1, ), ], "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host": [ Aaaa( ::1, ), ], "_clickhouse-admin-single-server._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 8888, target: "6df52bac-061c-4570-b9a6-63f0031151c4.host.control-plane.oxide.internal", }, ), ], }, }, ], }
14362026-03-03T16:56:44.436ZDEBGtest_metrics: client request body = Some(Body) method = PUT uri = http://[::1]:43957/config
14372026-03-03T16:56:44.436ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47656 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14382026-03-03T16:56:44.437ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392026-03-03T16:56:44.440ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
14402026-03-03T16:56:44.440ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14412026-03-03T16:56:44.440ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14422026-03-03T16:56:44.440ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14432026-03-03T16:56:44.441ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14442026-03-03T16:56:44.441ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14452026-03-03T16:56:44.441ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14462026-03-03T16:56:44.466ZINFOtest_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
14472026-03-03T16:56:44.466ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:33115/vpc-routes
14482026-03-03T16:56:44.471ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:43957 remote_addr = [::1]:55838
14492026-03-03T16:56:44.471ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = GET remote_addr = [::1]:47656 req_id = 85d74822-6012-4f36-8064-e2de1ea94b86 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
14502026-03-03T16:56:44.471ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = GET remote_addr = [::1]:47656 req_id = 85d74822-6012-4f36-8064-e2de1ea94b86 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
14512026-03-03T16:56:44.471ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47658 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
14522026-03-03T16:56:44.472ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 4d 32 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 M2..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:13509 req_id = 6d434622-748a-40b9-941a-addd90995f13
14532026-03-03T16:56:44.472ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 19762,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:13509 req_id = 6d434622-748a-40b9-941a-addd90995f13
14542026-03-03T16:56:44.472ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 19762, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:13509 req_id = 6d434622-748a-40b9-941a-addd90995f13
14552026-03-03T16:56:44.472ZINFOtest_metrics (dropshot): request completed latency_us = 703 local_addr = [::1]:33115 method = GET remote_addr = [::1]:47656 req_id = 85d74822-6012-4f36-8064-e2de1ea94b86 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
14562026-03-03T16:56:44.473ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
14572026-03-03T16:56:44.473ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14582026-03-03T16:56:44.473ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14592026-03-03T16:56:44.473ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14602026-03-03T16:56:44.473ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14612026-03-03T16:56:44.474ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
14622026-03-03T16:56:44.474ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
14632026-03-03T16:56:44.474ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14642026-03-03T16:56:44.474ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14652026-03-03T16:56:44.475ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14662026-03-03T16:56:44.476ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
14672026-03-03T16:56:44.476ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14682026-03-03T16:56:44.476ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14692026-03-03T16:56:44.476ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14702026-03-03T16:56:44.478ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14712026-03-03T16:56:44.481ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
14722026-03-03T16:56:44.481ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14732026-03-03T16:56:44.481ZDEBGtest_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14742026-03-03T16:56:44.481ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14752026-03-03T16:56:44.482ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14762026-03-03T16:56:44.482ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14772026-03-03T16:56:44.482ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14782026-03-03T16:56:44.483ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14792026-03-03T16:56:44.484ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14802026-03-03T16:56:44.489ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
14812026-03-03T16:56:44.489ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "Vpc" using built-in user background_task = service_firewall_rule_propagation
14822026-03-03T16:56:44.489ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14832026-03-03T16:56:44.489ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14842026-03-03T16:56:44.489ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14852026-03-03T16:56:44.492ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14862026-03-03T16:56:44.492ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14872026-03-03T16:56:44.493ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14882026-03-03T16:56:44.493ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = GET remote_addr = [::1]:47658 req_id = ffc6b98f-7ca4-4d0a-bf46-3a2ae8a9f192 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
14892026-03-03T16:56:44.493ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = GET remote_addr = [::1]:47658 req_id = ffc6b98f-7ca4-4d0a-bf46-3a2ae8a9f192 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
14902026-03-03T16:56:44.493ZWARNtest_metrics (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: looking up MGS addresses: proto error: no records found for Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
14912026-03-03T16:56:44.494ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 170.240571ms iteration = 2 status = {"error":"failed to collect inventory: looking up MGS addresses: proto error: no records found for Query { name: Name(\\"_mgs._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
14922026-03-03T16:56:44.494ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:33115/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "85d74822-6012-4f36-8064-e2de1ea94b86", "content-length": "2", "date": "Tue, 03 Mar 2026 16:56:44 GMT"} })
14932026-03-03T16:56:44.494ZINFOtest_metrics (BackgroundTasks): found opte v2p mappings background_task = v2p_manager interfaces = {} sled = SimGimlet00
14942026-03-03T16:56:44.494ZINFOtest_metrics (BackgroundTasks): v2p mappings to delete background_task = v2p_manager mappings = [] sled = SimGimlet00
14952026-03-03T16:56:44.494ZINFOtest_metrics (BackgroundTasks): v2p mappings to add background_task = v2p_manager mappings = [] sled = SimGimlet00
14962026-03-03T16:56:44.494ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 1.477002287s iteration = 1 status = {}
14972026-03-03T16:56:44.495ZINFOtest_metrics (dropshot): request completed latency_us = 1490 local_addr = [::1]:33115 method = GET remote_addr = [::1]:47658 req_id = ffc6b98f-7ca4-4d0a-bf46-3a2ae8a9f192 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
14982026-03-03T16:56:44.495ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 1.470897968s iteration = 1 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":0,"put_config_err":0,"put_config_ok":0,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":0,"put_config_err":0,"put_config_ok":0,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[]}
14992026-03-03T16:56:44.496ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:43957 method = PUT remote_addr = [::1]:55838 req_id = 5f2f459e-a915-4321-827a-4368338292a6 uri = /config
15002026-03-03T16:56:44.496ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:43957 method = PUT remote_addr = [::1]:55838 req_id = 5f2f459e-a915-4321-827a-4368338292a6 uri = /config version = 2.0.0
15012026-03-03T16:56:44.498ZINFOtest_metrics (store): attempting generation update new_generation = 1 req_id = 5f2f459e-a915-4321-827a-4368338292a6
15022026-03-03T16:56:44.498ZINFOtest_metrics (store): pruning trees for generations newer than 0
15032026-03-03T16:56:44.498ZDEBGtest_metrics (store): creating tree tree_name = generation_1_zone_control-plane.oxide.internal
15042026-03-03T16:56:44.498ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:33115/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffc6b98f-7ca4-4d0a-bf46-3a2ae8a9f192", "content-length": "2", "date": "Tue, 03 Mar 2026 16:56:44 GMT"} })
15052026-03-03T16:56:44.498ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
15062026-03-03T16:56:44.498ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15072026-03-03T16:56:44.499ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15082026-03-03T16:56:44.499ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15092026-03-03T16:56:44.499ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15102026-03-03T16:56:44.500ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15112026-03-03T16:56:44.500ZDEBGtest_metrics (store): updating current config
15122026-03-03T16:56:44.500ZDEBGtest_metrics (store): flushing default tree
15132026-03-03T16:56:44.544ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15142026-03-03T16:56:44.544ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15152026-03-03T16:56:44.544ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15162026-03-03T16:56:44.547ZINFOtest_metrics (store): pruning trees for generations older than 1 keep = 3
15172026-03-03T16:56:44.547ZINFOtest_metrics (store): updated generation new_generation = 1 req_id = 5f2f459e-a915-4321-827a-4368338292a6
15182026-03-03T16:56:44.547ZINFOtest_metrics (http): request completed kind = dns latency_us = 50984 local_addr = [::1]:43957 method = PUT remote_addr = [::1]:55838 req_id = 5f2f459e-a915-4321-827a-4368338292a6 response_code = 204 uri = /config
15192026-03-03T16:56:44.547ZDEBGtest_metrics: client response result = Ok(Response { url: "http://[::1]:43957/config", status: 204, headers: {"x-request-id": "5f2f459e-a915-4321-827a-4368338292a6", "date": "Tue, 03 Mar 2026 16:56:44 GMT"} })
15202026-03-03T16:56:44.547ZDEBGtest_metrics (init_with_steps): Running step configure_sled_agents
15212026-03-03T16:56:44.557ZDEBGtest_metrics: client request body = Some(Body) method = PUT uri = http://[::1]:33115/omicron-config
15222026-03-03T16:56:44.557ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
15232026-03-03T16:56:44.557ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
15242026-03-03T16:56:44.557ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15252026-03-03T16:56:44.557ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15262026-03-03T16:56:44.558ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15272026-03-03T16:56:44.559ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47660 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15282026-03-03T16:56:44.560ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47660 req_id = dbe15136-e6fc-4cc7-af58-6b7047c24e58 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config
15292026-03-03T16:56:44.560ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47660 req_id = dbe15136-e6fc-4cc7-af58-6b7047c24e58 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config version = 23.0.0
15302026-03-03T16:56:44.563ZINFOtest_metrics (dropshot): request completed latency_us = 3185 local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47660 req_id = dbe15136-e6fc-4cc7-af58-6b7047c24e58 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config
15312026-03-03T16:56:44.564ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
15322026-03-03T16:56:44.564ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15332026-03-03T16:56:44.564ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15342026-03-03T16:56:44.565ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15352026-03-03T16:56:44.567ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15362026-03-03T16:56:44.567ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15372026-03-03T16:56:44.567ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15382026-03-03T16:56:44.568ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15392026-03-03T16:56:44.568ZDEBGtest_metrics: client response result = Ok(Response { url: "http://[::1]:33115/omicron-config", status: 204, headers: {"x-request-id": "dbe15136-e6fc-4cc7-af58-6b7047c24e58", "date": "Tue, 03 Mar 2026 16:56:44 GMT"} })
15402026-03-03T16:56:44.570ZDEBGtest_metrics: client request body = Some(Body) method = PUT uri = http://[::1]:33115/network-bootstore-config
15412026-03-03T16:56:44.570ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47660 req_id = 693e1a38-0e4b-4d52-a882-fa8cec940102 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config
15422026-03-03T16:56:44.570ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47660 req_id = 693e1a38-0e4b-4d52-a882-fa8cec940102 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config version = 23.0.0
15432026-03-03T16:56:44.570ZINFOtest_metrics (dropshot): request completed latency_us = 307 local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47660 req_id = 693e1a38-0e4b-4d52-a882-fa8cec940102 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config
15442026-03-03T16:56:44.570ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15452026-03-03T16:56:44.577ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15462026-03-03T16:56:44.577ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = service_firewall_rule_propagation
15472026-03-03T16:56:44.577ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
15482026-03-03T16:56:44.577ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
15492026-03-03T16:56:44.577ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15502026-03-03T16:56:44.577ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15512026-03-03T16:56:44.577ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15522026-03-03T16:56:44.578ZINFOtest_metrics (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = SimGimlet00
15532026-03-03T16:56:44.578ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:33115/eip-gateways
15542026-03-03T16:56:44.579ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47658 req_id = 0d395ae0-0af6-458d-ba16-1c59e62a58cb sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
15552026-03-03T16:56:44.579ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47658 req_id = 0d395ae0-0af6-458d-ba16-1c59e62a58cb sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways version = 23.0.0
15562026-03-03T16:56:44.579ZINFOtest_metrics (dropshot): request completed latency_us = 209 local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47658 req_id = 0d395ae0-0af6-458d-ba16-1c59e62a58cb response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
15572026-03-03T16:56:44.579ZDEBGtest_metrics: client response result = Ok(Response { url: "http://[::1]:33115/network-bootstore-config", status: 204, headers: {"x-request-id": "693e1a38-0e4b-4d52-a882-fa8cec940102", "date": "Tue, 03 Mar 2026 16:56:44 GMT"} })
15582026-03-03T16:56:44.579ZDEBGtest_metrics (init_with_steps): Running step start_nexus_external
15592026-03-03T16:56:44.579ZDEBGtest_metrics: Starting Nexus (external API)
15602026-03-03T16:56:44.580ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:33115/eip-gateways", status: 204, headers: {"x-request-id": "0d395ae0-0af6-458d-ba16-1c59e62a58cb", "date": "Tue, 03 Mar 2026 16:56:44 GMT"} })
15612026-03-03T16:56:44.580ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 344.674688ms iteration = 2 status = {}
15622026-03-03T16:56:44.581ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
15632026-03-03T16:56:44.581ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15642026-03-03T16:56:44.581ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15652026-03-03T16:56:44.582ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15662026-03-03T16:56:44.585ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15672026-03-03T16:56:44.585ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15682026-03-03T16:56:44.585ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15692026-03-03T16:56:44.585ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15702026-03-03T16:56:44.594ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
15712026-03-03T16:56:44.594ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15722026-03-03T16:56:44.594ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
15732026-03-03T16:56:44.594ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
15742026-03-03T16:56:44.597ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
15752026-03-03T16:56:44.597ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15762026-03-03T16:56:44.603ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15772026-03-03T16:56:44.603ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15782026-03-03T16:56:44.603ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15792026-03-03T16:56:44.603ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15802026-03-03T16:56:44.606ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15812026-03-03T16:56:44.608ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
15822026-03-03T16:56:44.608ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
15832026-03-03T16:56:44.608ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
15842026-03-03T16:56:44.610ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
15852026-03-03T16:56:44.614ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
15862026-03-03T16:56:44.614ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
15872026-03-03T16:56:44.614ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
15882026-03-03T16:56:44.615ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15892026-03-03T16:56:44.615ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15902026-03-03T16:56:44.615ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15912026-03-03T16:56:44.617ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15922026-03-03T16:56:44.617ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15932026-03-03T16:56:44.617ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15942026-03-03T16:56:44.618ZINFOtest_metrics (InternalApi): set cockroachdb setting setting = cluster.preserve_downgrade_option value = 22.1
15952026-03-03T16:56:44.618ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
15962026-03-03T16:56:44.618ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
15972026-03-03T16:56:44.618ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
15982026-03-03T16:56:44.619ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15992026-03-03T16:56:44.619ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16002026-03-03T16:56:44.619ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16012026-03-03T16:56:44.620ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
16022026-03-03T16:56:44.620ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16032026-03-03T16:56:44.620ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16042026-03-03T16:56:44.620ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16052026-03-03T16:56:44.621ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16062026-03-03T16:56:44.621ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16072026-03-03T16:56:44.621ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16082026-03-03T16:56:44.622ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16092026-03-03T16:56:44.623ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16102026-03-03T16:56:44.626ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
16112026-03-03T16:56:44.626ZDEBGtest_metrics (InternalApi): updating rack subnet for rack c19a698f-c6f9-4a17-ae30-20d711b8f7dc to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), )
16122026-03-03T16:56:44.626ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16132026-03-03T16:56:44.627ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16142026-03-03T16:56:44.627ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16152026-03-03T16:56:44.627ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
16162026-03-03T16:56:44.627ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
16172026-03-03T16:56:44.627ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16182026-03-03T16:56:44.627ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16192026-03-03T16:56:44.628ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16202026-03-03T16:56:44.629ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
16212026-03-03T16:56:44.629ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16222026-03-03T16:56:44.629ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16232026-03-03T16:56:44.629ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16242026-03-03T16:56:44.630ZINFOtest_metrics (InternalApi): Using static configuration for external switchports
16252026-03-03T16:56:44.630ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16262026-03-03T16:56:44.630ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16272026-03-03T16:56:44.630ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16282026-03-03T16:56:44.631ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16292026-03-03T16:56:44.631ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16302026-03-03T16:56:44.631ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16312026-03-03T16:56:44.632ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16322026-03-03T16:56:44.633ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16332026-03-03T16:56:44.638ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
16342026-03-03T16:56:44.638ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = service_firewall_rule_propagation
16352026-03-03T16:56:44.638ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
16362026-03-03T16:56:44.638ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
16372026-03-03T16:56:44.639ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16382026-03-03T16:56:44.639ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16392026-03-03T16:56:44.640ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16402026-03-03T16:56:44.642ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
16412026-03-03T16:56:44.642ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16422026-03-03T16:56:44.642ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16432026-03-03T16:56:44.642ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16442026-03-03T16:56:44.647ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16452026-03-03T16:56:44.647ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16462026-03-03T16:56:44.647ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16472026-03-03T16:56:44.647ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16482026-03-03T16:56:44.648ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16492026-03-03T16:56:44.648ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16502026-03-03T16:56:44.649ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16512026-03-03T16:56:44.649ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16522026-03-03T16:56:44.655ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
16532026-03-03T16:56:44.655ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16542026-03-03T16:56:44.655ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16552026-03-03T16:56:44.658ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16562026-03-03T16:56:44.662ZDEBGtest_metrics (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
16572026-03-03T16:56:44.663ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Fleet
16582026-03-03T16:56:44.663ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16592026-03-03T16:56:44.663ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16602026-03-03T16:56:44.663ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16612026-03-03T16:56:44.663ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16622026-03-03T16:56:44.667ZINFOtest_metrics (InternalApi): Recording Rack Network Configuration
16632026-03-03T16:56:44.667ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16642026-03-03T16:56:44.667ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16652026-03-03T16:56:44.668ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16662026-03-03T16:56:44.668ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16672026-03-03T16:56:44.672ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
16682026-03-03T16:56:44.672ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16692026-03-03T16:56:44.672ZDEBGtest_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16702026-03-03T16:56:44.672ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16712026-03-03T16:56:44.694ZTRACtest_metrics (service-firewall-rule-progator): fetched allowlist from DB allowed = AllowList { id: 001de000-a110-4000-8000-000000000000, time_created: 2026-03-03T16:36:34.361106Z, time_modified: 2026-03-03T16:36:34.361106Z, allowed_ips: None } background_task = service_firewall_rule_propagation
16722026-03-03T16:56:44.694ZDEBGtest_metrics (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
16732026-03-03T16:56:44.695ZDEBGtest_metrics (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
16742026-03-03T16:56:44.695ZDEBGtest_metrics (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
16752026-03-03T16:56:44.778ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
16762026-03-03T16:56:44.778ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16772026-03-03T16:56:44.778ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16782026-03-03T16:56:44.778ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16792026-03-03T16:56:44.779ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16802026-03-03T16:56:44.781ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16812026-03-03T16:56:44.783ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
16822026-03-03T16:56:44.783ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16832026-03-03T16:56:44.783ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16842026-03-03T16:56:44.784ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16852026-03-03T16:56:44.792ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 8f44ff83-e683-47c2-b649-98429109ba78, lookup_type: ByName("oxide-service-pool-v4") }
16862026-03-03T16:56:44.792ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16872026-03-03T16:56:44.793ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16882026-03-03T16:56:44.793ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16892026-03-03T16:56:44.793ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16902026-03-03T16:56:44.799ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16912026-03-03T16:56:44.830ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 8f44ff83-e683-47c2-b649-98429109ba78, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
16922026-03-03T16:56:44.831ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16932026-03-03T16:56:44.831ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16942026-03-03T16:56:44.831ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16952026-03-03T16:56:44.835ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: e7523fa6-1446-4c7d-80fb-54b2b3bcd95b, lookup_type: ByName("oxide-service-pool-v6") }
16962026-03-03T16:56:44.835ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16972026-03-03T16:56:44.835ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16982026-03-03T16:56:44.835ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16992026-03-03T16:56:44.835ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17002026-03-03T16:56:44.837ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17012026-03-03T16:56:44.841ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: e7523fa6-1446-4c7d-80fb-54b2b3bcd95b, lookup_type: ByName("oxide-service-pool-v6") } result = Ok(())
17022026-03-03T16:56:44.841ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17032026-03-03T16:56:44.841ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17042026-03-03T16:56:44.841ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17052026-03-03T16:56:44.843ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 8f44ff83-e683-47c2-b649-98429109ba78, lookup_type: ByName("oxide-service-pool-v4") }
17062026-03-03T16:56:44.843ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17072026-03-03T16:56:44.843ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17082026-03-03T16:56:44.843ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17092026-03-03T16:56:44.843ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17102026-03-03T16:56:44.848ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17112026-03-03T16:56:44.855ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 8f44ff83-e683-47c2-b649-98429109ba78, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
17122026-03-03T16:56:44.867ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 8f44ff83-e683-47c2-b649-98429109ba78, lookup_type: ByName("oxide-service-pool-v4") }
17132026-03-03T16:56:44.867ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17142026-03-03T16:56:44.868ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17152026-03-03T16:56:44.868ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17162026-03-03T16:56:44.868ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17172026-03-03T16:56:44.870ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17182026-03-03T16:56:44.874ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 8f44ff83-e683-47c2-b649-98429109ba78, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
17192026-03-03T16:56:44.878ZDEBGtest_metrics (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
17202026-03-03T16:56:44.878ZDEBGtest_metrics (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
17212026-03-03T16:56:44.878ZINFOtest_metrics (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation
17222026-03-03T16:56:44.878ZDEBGtest_metrics (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 1.857813773s
17232026-03-03T16:56:44.878ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 1.857836413s iteration = 1 status = {}
17242026-03-03T16:56:44.878ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: e7523fa6-1446-4c7d-80fb-54b2b3bcd95b, lookup_type: ByName("oxide-service-pool-v6") }
17252026-03-03T16:56:44.878ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17262026-03-03T16:56:44.878ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17272026-03-03T16:56:44.878ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17282026-03-03T16:56:44.879ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17292026-03-03T16:56:44.880ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17302026-03-03T16:56:44.884ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: e7523fa6-1446-4c7d-80fb-54b2b3bcd95b, lookup_type: ByName("oxide-service-pool-v6") } result = Ok(())
17312026-03-03T16:56:44.889ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig
17322026-03-03T16:56:44.889ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17332026-03-03T16:56:44.889ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17342026-03-03T16:56:44.889ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17352026-03-03T16:56:44.890ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17362026-03-03T16:56:44.907ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17372026-03-03T16:56:44.910ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig result = Ok(())
17382026-03-03T16:56:45.020ZINFOtest_metrics (InternalApi): inserted blueprint blueprint_id = 17e53f87-23ca-4758-8dd3-9566e405f268
17392026-03-03T16:56:45.020ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig
17402026-03-03T16:56:45.020ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17412026-03-03T16:56:45.020ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17422026-03-03T16:56:45.020ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17432026-03-03T16:56:45.020ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17442026-03-03T16:56:45.021ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17452026-03-03T16:56:45.024ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig result = Ok(())
17462026-03-03T16:56:45.077ZINFOtest_metrics (InternalApi): Inserted networking records for boundary_ntp service
17472026-03-03T16:56:45.077ZINFOtest_metrics (InternalApi): No networking records needed for cockroach_db service
17482026-03-03T16:56:45.077ZINFOtest_metrics (InternalApi): No networking records needed for internal_dns service
17492026-03-03T16:56:45.077ZINFOtest_metrics (InternalApi): No networking records needed for clickhouse service
17502026-03-03T16:56:45.077ZINFOtest_metrics (InternalApi): No networking records needed for crucible_pantry service
17512026-03-03T16:56:45.090ZINFOtest_metrics (InternalApi): Inserted networking records for nexus service
17522026-03-03T16:56:45.100ZINFOtest_metrics (InternalApi): Inserted networking records for external_dns service
17532026-03-03T16:56:45.100ZINFOtest_metrics (InternalApi): Inserted service networking records
17542026-03-03T16:56:45.100ZINFOtest_metrics (InternalApi): Inserted physical disks
17552026-03-03T16:56:45.100ZINFOtest_metrics (InternalApi): Inserted zpools
17562026-03-03T16:56:45.100ZINFOtest_metrics (InternalApi): Inserted datasets
17572026-03-03T16:56:45.109ZINFOtest_metrics (InternalApi): Populated DNS tables for internal DNS
17582026-03-03T16:56:45.110ZINFOtest_metrics (InternalApi): Populated DNS tables for external DNS
17592026-03-03T16:56:45.110ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
17602026-03-03T16:56:45.111ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17612026-03-03T16:56:45.111ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17622026-03-03T16:56:45.111ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17632026-03-03T16:56:45.111ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17642026-03-03T16:56:45.113ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17652026-03-03T16:56:45.115ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
17662026-03-03T16:56:45.115ZTRACtest_metrics (InternalApi): authorize begin action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
17672026-03-03T16:56:45.115ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17682026-03-03T16:56:45.115ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17692026-03-03T16:56:45.115ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17702026-03-03T16:56:45.116ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17712026-03-03T16:56:45.117ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17722026-03-03T16:56:45.122ZDEBGtest_metrics (InternalApi): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
17732026-03-03T16:56:45.139ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig
17742026-03-03T16:56:45.139ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17752026-03-03T16:56:45.139ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17762026-03-03T16:56:45.139ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17772026-03-03T16:56:45.140ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17782026-03-03T16:56:45.142ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17792026-03-03T16:56:45.146ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig result = Ok(())
17802026-03-03T16:56:45.146ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig
17812026-03-03T16:56:45.146ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17822026-03-03T16:56:45.146ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17832026-03-03T16:56:45.146ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17842026-03-03T16:56:45.147ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17852026-03-03T16:56:45.149ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17862026-03-03T16:56:45.154ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig result = Ok(())
17872026-03-03T16:56:45.155ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig
17882026-03-03T16:56:45.155ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17892026-03-03T16:56:45.155ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17902026-03-03T16:56:45.155ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17912026-03-03T16:56:45.155ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17922026-03-03T16:56:45.157ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17932026-03-03T16:56:45.161ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig result = Ok(())
17942026-03-03T16:56:45.167ZINFOtest_metrics (InternalApi): Created recovery silo
17952026-03-03T16:56:45.167ZINFOtest_metrics (InternalApi): Created recovery user
17962026-03-03T16:56:45.170ZINFOtest_metrics (InternalApi): Created recovery user's password
17972026-03-03T16:56:45.170ZTRACtest_metrics (InternalApi): authorize begin action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Silo { parent: Fleet, key: a0294ab6-1cc7-4414-8202-8a72ff886df9, lookup_type: ById(a0294ab6-1cc7-4414-8202-8a72ff886df9) }
17982026-03-03T16:56:45.170ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = a0294ab6-1cc7-4414-8202-8a72ff886df9 resource_type = Silo
17992026-03-03T16:56:45.170ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18002026-03-03T16:56:45.170ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18012026-03-03T16:56:45.171ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18022026-03-03T16:56:45.172ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18032026-03-03T16:56:45.172ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18042026-03-03T16:56:45.172ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18052026-03-03T16:56:45.173ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18062026-03-03T16:56:45.174ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18072026-03-03T16:56:45.177ZDEBGtest_metrics (InternalApi): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Silo { parent: Fleet, key: a0294ab6-1cc7-4414-8202-8a72ff886df9, lookup_type: ById(a0294ab6-1cc7-4414-8202-8a72ff886df9) } result = Ok(())
18082026-03-03T16:56:45.177ZDEBGtest_metrics (InternalApi): Generated role assignment queries
18092026-03-03T16:56:45.180ZINFOtest_metrics (InternalApi): Granted Silo privileges
18102026-03-03T16:56:45.180ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
18112026-03-03T16:56:45.180ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18122026-03-03T16:56:45.181ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18132026-03-03T16:56:45.181ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18142026-03-03T16:56:45.187ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18152026-03-03T16:56:45.189ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18162026-03-03T16:56:45.191ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
18172026-03-03T16:56:45.192ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
18182026-03-03T16:56:45.193ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18192026-03-03T16:56:45.193ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18202026-03-03T16:56:45.193ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18212026-03-03T16:56:45.193ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18222026-03-03T16:56:45.195ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18232026-03-03T16:56:45.198ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
18242026-03-03T16:56:45.198ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
18252026-03-03T16:56:45.198ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18262026-03-03T16:56:45.198ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18272026-03-03T16:56:45.198ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18282026-03-03T16:56:45.198ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18292026-03-03T16:56:45.200ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18302026-03-03T16:56:45.207ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
18312026-03-03T16:56:45.225ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
18322026-03-03T16:56:45.225ZDEBGtest_metrics (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18332026-03-03T16:56:45.225ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
18342026-03-03T16:56:45.225ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18352026-03-03T16:56:45.225ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18362026-03-03T16:56:45.226ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
18372026-03-03T16:56:45.226ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal
18382026-03-03T16:56:45.226ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
18392026-03-03T16:56:45.226ZDEBGtest_metrics (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18402026-03-03T16:56:45.226ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
18412026-03-03T16:56:45.226ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18422026-03-03T16:56:45.226ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18432026-03-03T16:56:45.227ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
18442026-03-03T16:56:45.227ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal
18452026-03-03T16:56:45.230ZDEBGtest_metrics (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
18462026-03-03T16:56:45.230ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet
18472026-03-03T16:56:45.230ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18482026-03-03T16:56:45.230ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
18492026-03-03T16:56:45.230ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18502026-03-03T16:56:45.230ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
18512026-03-03T16:56:45.231ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Signaled
18522026-03-03T16:56:45.231ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
18532026-03-03T16:56:45.231ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18542026-03-03T16:56:45.231ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
18552026-03-03T16:56:45.231ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18562026-03-03T16:56:45.231ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
18572026-03-03T16:56:45.231ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Signaled
18582026-03-03T16:56:45.231ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig
18592026-03-03T16:56:45.231ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18602026-03-03T16:56:45.231ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
18612026-03-03T16:56:45.231ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18622026-03-03T16:56:45.231ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
18632026-03-03T16:56:45.232ZTRACtest_metrics (dns): buffer buffer = Length: 75 (0x4b) bytes\n0000: 8a ef 01 00 00 01 00 00 00 00 00 01 0c 5f 6e 61 ............._na\n0010: 6d 65 73 65 72 76 69 63 65 04 5f 74 63 70 0d 63 meservice._tcp.c\n0020: 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 ontrol-plane.oxi\n0030: 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 de.internal..!..\n0040: 00 00 29 04 d0 00 00 00 00 00 00 ..)........ kind = dns peer_addr = [::1]:1924 req_id = 37f5c024-9fcd-4d66-8e1f-2325b8a7da8f
18642026-03-03T16:56:45.233ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 35567,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_nameservice._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_nameservice._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 12,\n 95,\n 110,\n 97,\n 109,\n 101,\n 115,\n 101,\n 114,\n 118,\n 105,\n 99,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:1924 req_id = 37f5c024-9fcd-4d66-8e1f-2325b8a7da8f
18652026-03-03T16:56:45.233ZDEBGtest_metrics (store): query key key = _nameservice._tcp
18662026-03-03T16:56:45.233ZDEBGtest_metrics (store): query key key = 5af26469-64ce-4f90-bbd5-93c35e3638d1.host
18672026-03-03T16:56:45.233ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("5af26469-64ce-4f90-bbd5-93c35e3638d1.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:1924 query = LowerQuery { name: LowerName(Name("_nameservice._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43957, target: Name("5af26469-64ce-4f90-bbd5-93c35e3638d1.host.control-plane.oxide.internal") }) }] req_id = 37f5c024-9fcd-4d66-8e1f-2325b8a7da8f
18682026-03-03T16:56:45.233ZTRACtest_metrics (dns): buffer buffer = Length: 76 (0x4c) bytes\n0000: 58 f0 01 00 00 01 00 00 00 00 00 01 0d 5f 65 78 X............_ex\n0010: 74 65 72 6e 61 6c 2d 64 6e 73 04 5f 74 63 70 0d ternal-dns._tcp.\n0020: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0030: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 ide.internal..!.\n0040: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:11497 req_id = a82f56be-5347-4f3b-bc3b-34f4a6926629
18692026-03-03T16:56:45.233ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 22768,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_external-dns._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_external-dns._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 13,\n 95,\n 101,\n 120,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 45,\n 100,\n 110,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:11497 req_id = a82f56be-5347-4f3b-bc3b-34f4a6926629
18702026-03-03T16:56:45.233ZDEBGtest_metrics (store): query key key = _external-dns._tcp
18712026-03-03T16:56:45.233ZDEBGtest_metrics (store): query key key = 9f9be08c-87bc-4246-a3f7-f9772fad7223.host
18722026-03-03T16:56:45.233ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("9f9be08c-87bc-4246-a3f7-f9772fad7223.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:11497 query = LowerQuery { name: LowerName(Name("_external-dns._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39361, target: Name("9f9be08c-87bc-4246-a3f7-f9772fad7223.host.control-plane.oxide.internal") }) }] req_id = a82f56be-5347-4f3b-bc3b-34f4a6926629
18732026-03-03T16:56:45.233ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
18742026-03-03T16:56:45.233ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18752026-03-03T16:56:45.233ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
18762026-03-03T16:56:45.233ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18772026-03-03T16:56:45.239ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18782026-03-03T16:56:45.239ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
18792026-03-03T16:56:45.239ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18802026-03-03T16:56:45.239ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
18812026-03-03T16:56:45.239ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18822026-03-03T16:56:45.240ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18832026-03-03T16:56:45.240ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18842026-03-03T16:56:45.245ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18852026-03-03T16:56:45.245ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
18862026-03-03T16:56:45.245ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18872026-03-03T16:56:45.245ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
18882026-03-03T16:56:45.245ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18892026-03-03T16:56:45.249ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18902026-03-03T16:56:45.249ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
18912026-03-03T16:56:45.249ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18922026-03-03T16:56:45.250ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
18932026-03-03T16:56:45.252ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18942026-03-03T16:56:45.256ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
18952026-03-03T16:56:45.257ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
18962026-03-03T16:56:45.257ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18972026-03-03T16:56:45.257ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
18982026-03-03T16:56:45.260ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
18992026-03-03T16:56:45.260ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
19002026-03-03T16:56:45.261ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17e53f87-23ca-4758-8dd3-9566e405f268, lookup_type: ById(17e53f87-23ca-4758-8dd3-9566e405f268) }
19012026-03-03T16:56:45.261ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19022026-03-03T16:56:45.261ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
19032026-03-03T16:56:45.261ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19042026-03-03T16:56:45.263ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
19052026-03-03T16:56:45.264ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig
19062026-03-03T16:56:45.264ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19072026-03-03T16:56:45.264ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
19082026-03-03T16:56:45.264ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19092026-03-03T16:56:45.266ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
19102026-03-03T16:56:45.267ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19112026-03-03T16:56:45.278ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19122026-03-03T16:56:45.279ZDEBGtest_metrics (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19132026-03-03T16:56:45.280ZDEBGtest_metrics (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19142026-03-03T16:56:45.280ZDEBGtest_metrics (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19152026-03-03T16:56:45.280ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
19162026-03-03T16:56:45.280ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19172026-03-03T16:56:45.280ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
19182026-03-03T16:56:45.280ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19192026-03-03T16:56:45.280ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19202026-03-03T16:56:45.281ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43957, target: Name("5af26469-64ce-4f90-bbd5-93c35e3638d1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5af26469-64ce-4f90-bbd5-93c35e3638d1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1867, tv_nsec: 537889220 } })
19212026-03-03T16:56:45.281ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
19222026-03-03T16:56:45.281ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39361, target: Name("9f9be08c-87bc-4246-a3f7-f9772fad7223.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9f9be08c-87bc-4246-a3f7-f9772fad7223.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1867, tv_nsec: 538173041 } })
19232026-03-03T16:56:45.281ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
19242026-03-03T16:56:45.282ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19252026-03-03T16:56:45.289ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19262026-03-03T16:56:45.290ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19272026-03-03T16:56:45.294ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19282026-03-03T16:56:45.300ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
19292026-03-03T16:56:45.300ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19302026-03-03T16:56:45.300ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19312026-03-03T16:56:45.300ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19322026-03-03T16:56:45.306ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17e53f87-23ca-4758-8dd3-9566e405f268, lookup_type: ById(17e53f87-23ca-4758-8dd3-9566e405f268) } result = Ok(())
19332026-03-03T16:56:45.307ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
19342026-03-03T16:56:45.307ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19352026-03-03T16:56:45.307ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
19362026-03-03T16:56:45.308ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372026-03-03T16:56:45.317ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19382026-03-03T16:56:45.317ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
19392026-03-03T16:56:45.317ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19402026-03-03T16:56:45.317ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
19412026-03-03T16:56:45.321ZDEBGtest_metrics (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19422026-03-03T16:56:45.321ZDEBGtest_metrics (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19432026-03-03T16:56:45.321ZDEBGtest_metrics (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19442026-03-03T16:56:45.321ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
19452026-03-03T16:56:45.321ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19462026-03-03T16:56:45.321ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
19472026-03-03T16:56:45.321ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19482026-03-03T16:56:45.321ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19492026-03-03T16:56:45.322ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 08 fe 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:59424 req_id = 45e7ec41-3c02-495e-8124-39038e34b6fd
19502026-03-03T16:56:45.322ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 2302,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:59424 req_id = 45e7ec41-3c02-495e-8124-39038e34b6fd
19512026-03-03T16:56:45.322ZDEBGtest_metrics (store): query key key = _mgs._tcp
19522026-03-03T16:56:45.322ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
19532026-03-03T16:56:45.322ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:59424 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 45e7ec41-3c02-495e-8124-39038e34b6fd
19542026-03-03T16:56:45.323ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1867, tv_nsec: 579795567 } })
19552026-03-03T16:56:45.323ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
19562026-03-03T16:56:45.323ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 03 06 01 00 00 01 00 00 00 00 00 01 24 35 61 66 ............$5af\n0010: 32 36 34 36 39 2d 36 34 63 65 2d 34 66 39 30 2d 26469-64ce-4f90-\n0020: 62 62 64 35 2d 39 33 63 33 35 65 33 36 33 38 64 bbd5-93c35e3638d\n0030: 31 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 1.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:40576 req_id = 7738b60f-efac-43ba-8b96-791b7ea45905
19572026-03-03T16:56:45.323ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 774,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("5af26469-64ce-4f90-bbd5-93c35e3638d1.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("5af26469-64ce-4f90-bbd5-93c35e3638d1.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 53,\n 97,\n 102,\n 50,\n 54,\n 52,\n 54,\n 57,\n 45,\n 54,\n 52,\n 99,\n 101,\n 45,\n 52,\n 102,\n 57,\n 48,\n 45,\n 98,\n 98,\n 100,\n 53,\n 45,\n 57,\n 51,\n 99,\n 51,\n 53,\n 101,\n 51,\n 54,\n 51,\n 56,\n 100,\n 49,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:40576 req_id = 7738b60f-efac-43ba-8b96-791b7ea45905
19582026-03-03T16:56:45.323ZDEBGtest_metrics (store): query key key = 5af26469-64ce-4f90-bbd5-93c35e3638d1.host
19592026-03-03T16:56:45.323ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:40576 query = LowerQuery { name: LowerName(Name("5af26469-64ce-4f90-bbd5-93c35e3638d1.host.control-plane.oxide.internal.")), original: Query { name: Name("5af26469-64ce-4f90-bbd5-93c35e3638d1.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("5af26469-64ce-4f90-bbd5-93c35e3638d1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 7738b60f-efac-43ba-8b96-791b7ea45905
19602026-03-03T16:56:45.323ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 31 96 01 00 00 01 00 00 00 00 00 01 24 39 66 39 1...........$9f9\n0010: 62 65 30 38 63 2d 38 37 62 63 2d 34 32 34 36 2d be08c-87bc-4246-\n0020: 61 33 66 37 2d 66 39 37 37 32 66 61 64 37 32 32 a3f7-f9772fad722\n0030: 33 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 3.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:61769 req_id = 0c2a1dab-1cd3-4af9-97ed-c9b36c5bd6b0
19612026-03-03T16:56:45.323ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 12694,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("9f9be08c-87bc-4246-a3f7-f9772fad7223.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("9f9be08c-87bc-4246-a3f7-f9772fad7223.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 57,\n 102,\n 57,\n 98,\n 101,\n 48,\n 56,\n 99,\n 45,\n 56,\n 55,\n 98,\n 99,\n 45,\n 52,\n 50,\n 52,\n 54,\n 45,\n 97,\n 51,\n 102,\n 55,\n 45,\n 102,\n 57,\n 55,\n 55,\n 50,\n 102,\n 97,\n 100,\n 55,\n 50,\n 50,\n 51,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:61769 req_id = 0c2a1dab-1cd3-4af9-97ed-c9b36c5bd6b0
19622026-03-03T16:56:45.323ZDEBGtest_metrics (store): query key key = 9f9be08c-87bc-4246-a3f7-f9772fad7223.host
19632026-03-03T16:56:45.323ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:61769 query = LowerQuery { name: LowerName(Name("9f9be08c-87bc-4246-a3f7-f9772fad7223.host.control-plane.oxide.internal.")), original: Query { name: Name("9f9be08c-87bc-4246-a3f7-f9772fad7223.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("9f9be08c-87bc-4246-a3f7-f9772fad7223.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 0c2a1dab-1cd3-4af9-97ed-c9b36c5bd6b0
19642026-03-03T16:56:45.324ZINFOtest_metrics (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[::1]:43957] } background_task = dns_servers_internal dns_group = internal
19652026-03-03T16:56:45.324ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 97.973846ms iteration = 2 status = {"addresses":["[::1]:43957"]}
19662026-03-03T16:56:45.324ZINFOtest_metrics (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[::1]:39361] } background_task = dns_servers_external dns_group = external
19672026-03-03T16:56:45.324ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 97.137205ms iteration = 2 status = {"addresses":["[::1]:39361"]}
19682026-03-03T16:56:45.324ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
19692026-03-03T16:56:45.324ZWARNtest_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal reason = no config
19702026-03-03T16:56:45.324ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 24.79\u{b5}s iteration = 2 status = {"error":"no config"}
19712026-03-03T16:56:45.324ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
19722026-03-03T16:56:45.324ZWARNtest_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external reason = no config
19732026-03-03T16:56:45.324ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 4.71\u{b5}s iteration = 2 status = {"error":"no config"}
19742026-03-03T16:56:45.324ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: f7 86 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:40105 req_id = bf5625d4-be1f-435e-8afc-1f93b34d5862
19752026-03-03T16:56:45.324ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 63366,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:40105 req_id = bf5625d4-be1f-435e-8afc-1f93b34d5862
19762026-03-03T16:56:45.324ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
19772026-03-03T16:56:45.324ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:40105 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = bf5625d4-be1f-435e-8afc-1f93b34d5862
19782026-03-03T16:56:45.334ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
19792026-03-03T16:56:45.334ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: d4 04 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:7326 req_id = 2b21336c-5dd1-402b-bf40-56d79db93e32
19802026-03-03T16:56:45.334ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 54276,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:7326 req_id = 2b21336c-5dd1-402b-bf40-56d79db93e32
19812026-03-03T16:56:45.334ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
19822026-03-03T16:56:45.334ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 54276, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:7326 req_id = 2b21336c-5dd1-402b-bf40-56d79db93e32
19832026-03-03T16:56:45.335ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
19842026-03-03T16:56:45.335ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19852026-03-03T16:56:45.340ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19862026-03-03T16:56:45.340ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
19872026-03-03T16:56:45.340ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19882026-03-03T16:56:45.340ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19892026-03-03T16:56:45.341ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: 59 f4 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f Y............_co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:1647 req_id = 2c42fec0-a0c3-4086-8e40-8d4c292f0d78
19902026-03-03T16:56:45.341ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 23028,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:1647 req_id = 2c42fec0-a0c3-4086-8e40-8d4c292f0d78
19912026-03-03T16:56:45.341ZDEBGtest_metrics (store): query key key = _cockroach._tcp
19922026-03-03T16:56:45.341ZDEBGtest_metrics (store): query key key = 5003bd5e-8cef-4ba6-a473-d7948135a715.host
19932026-03-03T16:56:45.341ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:1647 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32943, target: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal") }) }] req_id = 2c42fec0-a0c3-4086-8e40-8d4c292f0d78
19942026-03-03T16:56:45.342ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32943, target: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1867, tv_nsec: 598548247 } })
19952026-03-03T16:56:45.342ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
19962026-03-03T16:56:45.342ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 4d d3 01 00 00 01 00 00 00 00 00 01 24 35 30 30 M...........$500\n0010: 33 62 64 35 65 2d 38 63 65 66 2d 34 62 61 36 2d 3bd5e-8cef-4ba6-\n0020: 61 34 37 33 2d 64 37 39 34 38 31 33 35 61 37 31 a473-d7948135a71\n0030: 35 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 5.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:35081 req_id = 3ccc8af3-cbe4-4d3a-a3f6-01a803b291eb
19972026-03-03T16:56:45.342ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 19923,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 53,\n 48,\n 48,\n 51,\n 98,\n 100,\n 53,\n 101,\n 45,\n 56,\n 99,\n 101,\n 102,\n 45,\n 52,\n 98,\n 97,\n 54,\n 45,\n 97,\n 52,\n 55,\n 51,\n 45,\n 100,\n 55,\n 57,\n 52,\n 56,\n 49,\n 51,\n 53,\n 97,\n 55,\n 49,\n 53,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:35081 req_id = 3ccc8af3-cbe4-4d3a-a3f6-01a803b291eb
19982026-03-03T16:56:45.342ZDEBGtest_metrics (store): query key key = 5003bd5e-8cef-4ba6-a473-d7948135a715.host
19992026-03-03T16:56:45.342ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:35081 query = LowerQuery { name: LowerName(Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal.")), original: Query { name: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 3ccc8af3-cbe4-4d3a-a3f6-01a803b291eb
20002026-03-03T16:56:45.351ZDEBGtest_metrics (CockroachClusterAdminClient): Updated CockroachDB cluster backends added = 1 addresses = [[::1]:32222] removed = 0 total = 1
20012026-03-03T16:56:45.351ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
20022026-03-03T16:56:45.351ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:36753
20032026-03-03T16:56:45.351ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/ignition
20042026-03-03T16:56:45.352ZDEBGtest_metrics (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20052026-03-03T16:56:45.353ZDEBGtest_metrics (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 816495d9-5e76-4773-ba1b-76421a7eb227 dns_zone_name = oxide-dev.test found_so_far = 0 version = 2
20062026-03-03T16:56:45.353ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
20072026-03-03T16:56:45.353ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20082026-03-03T16:56:45.353ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
20092026-03-03T16:56:45.353ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20102026-03-03T16:56:45.353ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20112026-03-03T16:56:45.355ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20122026-03-03T16:56:45.361ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20132026-03-03T16:56:45.361ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
20142026-03-03T16:56:45.361ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20152026-03-03T16:56:45.361ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20162026-03-03T16:56:45.362ZDEBGtest_metrics (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20172026-03-03T16:56:45.362ZDEBGtest_metrics (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 80498ddb-904d-401a-9e5c-42643f0582cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20182026-03-03T16:56:45.362ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
20192026-03-03T16:56:45.362ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20202026-03-03T16:56:45.362ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
20212026-03-03T16:56:45.362ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20222026-03-03T16:56:45.362ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20232026-03-03T16:56:45.365ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet
20242026-03-03T16:56:45.365ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20252026-03-03T16:56:45.365ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
20262026-03-03T16:56:45.365ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20272026-03-03T16:56:45.365ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
20282026-03-03T16:56:45.366ZDEBGtest_metrics (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 816495d9-5e76-4773-ba1b-76421a7eb227 dns_zone_name = oxide-dev.test found_so_far = 3 version = 2
20292026-03-03T16:56:45.366ZDEBGtest_metrics (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
20302026-03-03T16:56:45.366ZINFOtest_metrics (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external generation = 2
20312026-03-03T16:56:45.366ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 140.386073ms iteration = 2 status = {"generation":2}
20322026-03-03T16:56:45.366ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
20332026-03-03T16:56:45.377ZDEBGtest_metrics (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[::1]:39361 generation = 2 method = PUT servers = DnsServersList { addresses: [[::1]:39361] } uri = http://[::1]:39361/config
20342026-03-03T16:56:45.377ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20352026-03-03T16:56:45.382ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20362026-03-03T16:56:45.382ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
20372026-03-03T16:56:45.382ZDEBGtest_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20382026-03-03T16:56:45.382ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20392026-03-03T16:56:45.383ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20402026-03-03T16:56:45.386ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20412026-03-03T16:56:45.386ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
20422026-03-03T16:56:45.386ZDEBGtest_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20432026-03-03T16:56:45.386ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
20442026-03-03T16:56:45.387ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:39361 remote_addr = [::1]:42026
20452026-03-03T16:56:45.387ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6597987-8828-406e-91f5-036f727cb7f5", "content-length": "835", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
20462026-03-03T16:56:45.387ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0
20472026-03-03T16:56:45.388ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:39361 method = PUT remote_addr = [::1]:42026 req_id = b038e451-7b9d-44ea-aced-f45c27de49c4 uri = /config
20482026-03-03T16:56:45.388ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:39361 method = PUT remote_addr = [::1]:42026 req_id = b038e451-7b9d-44ea-aced-f45c27de49c4 uri = /config version = 2.0.0
20492026-03-03T16:56:45.388ZINFOtest_metrics (store): attempting generation update new_generation = 2 req_id = b038e451-7b9d-44ea-aced-f45c27de49c4
20502026-03-03T16:56:45.388ZINFOtest_metrics (store): pruning trees for generations newer than 0
20512026-03-03T16:56:45.388ZDEBGtest_metrics (store): creating tree tree_name = generation_2_zone_oxide-dev.test
20522026-03-03T16:56:45.389ZDEBGtest_metrics (store): updating current config
20532026-03-03T16:56:45.389ZDEBGtest_metrics (store): flushing default tree
20542026-03-03T16:56:45.389ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "faccc29c-e0ff-45ad-af23-7ae5c996fcf2", "content-length": "734", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
20552026-03-03T16:56:45.390ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=0
20562026-03-03T16:56:45.390ZDEBGtest_metrics (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 80498ddb-904d-401a-9e5c-42643f0582cf dns_zone_name = control-plane.oxide.internal found_so_far = 27 version = 1
20572026-03-03T16:56:45.390ZDEBGtest_metrics (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20582026-03-03T16:56:45.390ZINFOtest_metrics (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal generation = 1
20592026-03-03T16:56:45.390ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 165.626643ms iteration = 2 status = {"generation":1}
20602026-03-03T16:56:45.390ZDEBGtest_metrics (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
20612026-03-03T16:56:45.400ZDEBGtest_metrics (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[::1]:43957 generation = 1 method = PUT servers = DnsServersList { addresses: [[::1]:43957] } uri = http://[::1]:43957/config
20622026-03-03T16:56:45.400ZINFOtest_metrics (store): pruning trees for generations older than 2 keep = 3
20632026-03-03T16:56:45.400ZINFOtest_metrics (store): updated generation new_generation = 2 req_id = b038e451-7b9d-44ea-aced-f45c27de49c4
20642026-03-03T16:56:45.400ZINFOtest_metrics (http): request completed kind = dns latency_us = 12550 local_addr = [::1]:39361 method = PUT remote_addr = [::1]:42026 req_id = b038e451-7b9d-44ea-aced-f45c27de49c4 response_code = 204 uri = /config
20652026-03-03T16:56:45.401ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:43957 remote_addr = [::1]:55840
20662026-03-03T16:56:45.401ZDEBGtest_metrics (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[::1]:39361 generation = 2 result = Ok(Response { url: "http://[::1]:39361/config", status: 204, headers: {"x-request-id": "b038e451-7b9d-44ea-aced-f45c27de49c4", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} }) servers = DnsServersList { addresses: [[::1]:39361] }
20672026-03-03T16:56:45.401ZINFOtest_metrics (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[::1]:39361 generation = 2 servers = DnsServersList { addresses: [[::1]:39361] }
20682026-03-03T16:56:45.401ZINFOtest_metrics (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external generation = 2 servers = DnsServersList { addresses: [[::1]:39361] }
20692026-03-03T16:56:45.401ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 34.972336ms iteration = 3 status = {"generation":2,"server_results":{"[::1]:39361":{"Ok":null}}}
20702026-03-03T16:56:45.402ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:43957 method = PUT remote_addr = [::1]:55840 req_id = d9282caf-8806-4786-8cf1-d10ef807a940 uri = /config
20712026-03-03T16:56:45.402ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:43957 method = PUT remote_addr = [::1]:55840 req_id = d9282caf-8806-4786-8cf1-d10ef807a940 uri = /config version = 2.0.0
20722026-03-03T16:56:45.402ZINFOtest_metrics (store): attempting generation update new_generation = 1 req_id = d9282caf-8806-4786-8cf1-d10ef807a940
20732026-03-03T16:56:45.402ZINFOtest_metrics (store): updated generation new_generation = 1 req_id = d9282caf-8806-4786-8cf1-d10ef807a940
20742026-03-03T16:56:45.402ZINFOtest_metrics (http): request completed kind = dns latency_us = 622 local_addr = [::1]:43957 method = PUT remote_addr = [::1]:55840 req_id = d9282caf-8806-4786-8cf1-d10ef807a940 response_code = 204 uri = /config
20752026-03-03T16:56:45.403ZDEBGtest_metrics (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[::1]:43957 generation = 1 result = Ok(Response { url: "http://[::1]:43957/config", status: 204, headers: {"x-request-id": "d9282caf-8806-4786-8cf1-d10ef807a940", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} }) servers = DnsServersList { addresses: [[::1]:43957] }
20762026-03-03T16:56:45.403ZINFOtest_metrics (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[::1]:43957 generation = 1 servers = DnsServersList { addresses: [[::1]:43957] }
20772026-03-03T16:56:45.403ZINFOtest_metrics (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal generation = 1 servers = DnsServersList { addresses: [[::1]:43957] }
20782026-03-03T16:56:45.403ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 12.50507ms iteration = 3 status = {"generation":1,"server_results":{"[::1]:43957":{"Ok":null}}}
20792026-03-03T16:56:45.404ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b15c637-cc0c-467f-945e-e559cdd4a7ad", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
20802026-03-03T16:56:45.404ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=1
20812026-03-03T16:56:45.405ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9fe6460-b730-4764-a0be-26a2a869a2df", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
20822026-03-03T16:56:45.405ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=0
20832026-03-03T16:56:45.406ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "721d5c93-b95c-4a44-9dc0-443c4870c4b6", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
20842026-03-03T16:56:45.406ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=1
20852026-03-03T16:56:45.408ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "05be15e9-5ccb-4d8b-8a3e-1e0ad9087ad9", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
20862026-03-03T16:56:45.408ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=0
20872026-03-03T16:56:45.409ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "92855c6a-dd2b-4c6f-9bb4-13ae6718d178", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
20882026-03-03T16:56:45.409ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=1
20892026-03-03T16:56:45.410ZINFOtest_metrics (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader target_id = 17e53f87-23ca-4758-8dd3-9566e405f268 time_created = 2026-03-03 16:56:44.579590 UTC
20902026-03-03T16:56:45.410ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 181.595789ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"17e53f87-23ca-4758-8dd3-9566e405f268","time_created":"2026-03-03T16:56:44.579590Z","time_found":"2026-03-03T16:56:45.410046487Z"}
20912026-03-03T16:56:45.410ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
20922026-03-03T16:56:45.410ZDEBGtest_metrics (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
20932026-03-03T16:56:45.410ZINFOtest_metrics (NexusQuiesceHandle): initial state state = Running
20942026-03-03T16:56:45.410ZINFOtest_metrics (SagaQuiesceHandle): initial quiesce state initial_state = Allowed
20952026-03-03T16:56:45.410ZWARNtest_metrics (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor reason = blueprint disabled target_id = 17e53f87-23ca-4758-8dd3-9566e405f268
20962026-03-03T16:56:45.410ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 59.78\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"17e53f87-23ca-4758-8dd3-9566e405f268"}
20972026-03-03T16:56:45.410ZDEBGtest_metrics (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
20982026-03-03T16:56:45.410ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet
20992026-03-03T16:56:45.410ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = crdb_node_id_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21002026-03-03T16:56:45.410ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database
21012026-03-03T16:56:45.410ZDEBGtest_metrics (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21022026-03-03T16:56:45.411ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21032026-03-03T16:56:45.428ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 3 reason = Dependency
21042026-03-03T16:56:45.428ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
21052026-03-03T16:56:45.428ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 52.991\u{b5}s iteration = 3 status = "Disabled"
21062026-03-03T16:56:45.439ZTRACtest_metrics (ServiceBalancer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database
21072026-03-03T16:56:45.439ZDEBGtest_metrics (ServiceBalancer): roles roles = RoleSet { roles: {} }
21082026-03-03T16:56:45.439ZDEBGtest_metrics (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database result = Ok(())
21092026-03-03T16:56:45.440ZDEBGtest_metrics (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21102026-03-03T16:56:45.443ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21112026-03-03T16:56:45.443ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database
21122026-03-03T16:56:45.443ZDEBGtest_metrics (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21132026-03-03T16:56:45.443ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21142026-03-03T16:56:45.444ZINFOtest_metrics (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide-dev.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-03-03T16:56:42.208844Z, time_modified: 2026-03-03T16:56:42.208844Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "test-suite-silo.sys.oxide-dev.test": ExternalEndpoint { silo_id: a0294ab6-1cc7-4414-8202-8a72ff886df9, db_silo: Silo { identity: SiloIdentity { id: a0294ab6-1cc7-4414-8202-8a72ff886df9, name: Name(Name("test-suite-silo")), description: "built-in recovery Silo", time_created: 2026-03-03T16:56:45.110954Z, time_modified: 2026-03-03T16:56:45.110954Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide-dev.test" }, NoSiloCerts { silo_id: a0294ab6-1cc7-4414-8202-8a72ff886df9, dns_name: "test-suite-silo.sys.oxide-dev.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a0294ab6-1cc7-4414-8202-8a72ff886df9, db_silo: Silo { identity: SiloIdentity { id: a0294ab6-1cc7-4414-8202-8a72ff886df9, name: Name(Name("test-suite-silo")), description: "built-in recovery Silo", time_created: 2026-03-03T16:56:45.110954Z, time_modified: 2026-03-03T16:56:45.110954Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }) }
21152026-03-03T16:56:45.444ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 217.289646ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide-dev.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"test-suite-silo.sys.oxide-dev.test":{"silo_id":"a0294ab6-1cc7-4414-8202-8a72ff886df9","tls_certs":[]}},"default_endpoint":{"silo_id":"a0294ab6-1cc7-4414-8202-8a72ff886df9","tls_certs":[]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide-dev.test\\" has no usable certificates","silo a0294ab6-1cc7-4414-8202-8a72ff886df9 with DNS name \\"test-suite-silo.sys.oxide-dev.test\\" has no usable certificates"]}
21162026-03-03T16:56:45.445ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "57c69ff8-3412-476a-80f1-44b956f71dac", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21172026-03-03T16:56:45.445ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cmpa
21182026-03-03T16:56:45.446ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4be93f5a-b3f5-4601-9735-cf821d36b0ea", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21192026-03-03T16:56:45.446ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
21202026-03-03T16:56:45.447ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e524348-5d75-4ccb-ad8c-c95e8f2cfdfc", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21212026-03-03T16:56:45.447ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
21222026-03-03T16:56:45.471ZDEBGtest_metrics (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[::1]:32222/node/id
21232026-03-03T16:56:45.471ZTRACtest_metrics (ServiceBalancer): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
21242026-03-03T16:56:45.471ZTRACtest_metrics (ServiceBalancer): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21252026-03-03T16:56:45.471ZTRACtest_metrics (ServiceBalancer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database
21262026-03-03T16:56:45.471ZDEBGtest_metrics (ServiceBalancer): roles roles = RoleSet { roles: {} }
21272026-03-03T16:56:45.471ZDEBGtest_metrics (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database result = Ok(())
21282026-03-03T16:56:45.471ZDEBGtest_metrics (BackgroundTasks): client response background_task = crdb_node_id_collector result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
21292026-03-03T16:56:45.471ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 58.151033ms iteration = 2 status = {"errors":[{"err":"failed to fetch node ID for zone 5003bd5e-8cef-4ba6-a473-d7948135a715 at http://[::1]:32222: Communication Error: error sending request for url (http://[::1]:32222/node/id): error sending request for url (http://[::1]:32222/node/id): client error (Connect): tcp connect error: Connection refused (os error 111)","zone_id":"5003bd5e-8cef-4ba6-a473-d7948135a715"}],"nsuccess":0}
21302026-03-03T16:56:45.471ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "209b84e1-422e-456e-9aeb-3405bf3c9dac", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21312026-03-03T16:56:45.471ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
21322026-03-03T16:56:45.471ZDEBGtest_metrics (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21332026-03-03T16:56:45.474ZDEBGtest_metrics (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
21342026-03-03T16:56:45.474ZINFOtest_metrics (nexus): Rack initialized
21352026-03-03T16:56:45.474ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21362026-03-03T16:56:45.474ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21372026-03-03T16:56:45.478ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21382026-03-03T16:56:45.479ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3719d89-90d3-47b3-ba31-b60d08f24e0f", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21392026-03-03T16:56:45.482ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1
21402026-03-03T16:56:45.482ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21412026-03-03T16:56:45.482ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21422026-03-03T16:56:45.482ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21432026-03-03T16:56:45.483ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21442026-03-03T16:56:45.483ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21452026-03-03T16:56:45.483ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21462026-03-03T16:56:45.484ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "546d2d9f-f2b1-450f-98c1-81795b94e565", "content-length": "734", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21472026-03-03T16:56:45.484ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=0
21482026-03-03T16:56:45.485ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ebe00b8-df04-4f1d-88b3-9722d30d238b", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21492026-03-03T16:56:45.485ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=1
21502026-03-03T16:56:45.486ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
21512026-03-03T16:56:45.486ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
21522026-03-03T16:56:45.486ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21532026-03-03T16:56:45.486ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21542026-03-03T16:56:45.486ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21552026-03-03T16:56:45.488ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
21562026-03-03T16:56:45.488ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21572026-03-03T16:56:45.488ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21582026-03-03T16:56:45.488ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21592026-03-03T16:56:45.489ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "95317939-506f-4676-b8b5-f70189e56e97", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21602026-03-03T16:56:45.489ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=0
21612026-03-03T16:56:45.490ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21622026-03-03T16:56:45.490ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21632026-03-03T16:56:45.490ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21642026-03-03T16:56:45.491ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21652026-03-03T16:56:45.493ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21662026-03-03T16:56:45.498ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21672026-03-03T16:56:45.498ZTRACtest_metrics (InternalApi): successful lookup of siloed resource "Vpc" using built-in user
21682026-03-03T16:56:45.498ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
21692026-03-03T16:56:45.498ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
21702026-03-03T16:56:45.498ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21712026-03-03T16:56:45.498ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21722026-03-03T16:56:45.499ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21732026-03-03T16:56:45.500ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba7ae830-6621-47b6-ac03-3ae5bd66147f", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21742026-03-03T16:56:45.500ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=1
21752026-03-03T16:56:45.505ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
21762026-03-03T16:56:45.505ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21772026-03-03T16:56:45.505ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21782026-03-03T16:56:45.505ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21792026-03-03T16:56:45.507ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21802026-03-03T16:56:45.507ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21812026-03-03T16:56:45.507ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21822026-03-03T16:56:45.508ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21832026-03-03T16:56:45.509ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e462174-e8d3-4b4d-8463-358931836d8e", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21842026-03-03T16:56:45.509ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=0
21852026-03-03T16:56:45.510ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21862026-03-03T16:56:45.515ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21872026-03-03T16:56:45.515ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21882026-03-03T16:56:45.515ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21892026-03-03T16:56:45.516ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21902026-03-03T16:56:45.524ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9df28985-abeb-4e1a-b465-1c75c7da4b1b", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21912026-03-03T16:56:45.525ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=1
21922026-03-03T16:56:45.526ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21932026-03-03T16:56:45.526ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21942026-03-03T16:56:45.527ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
21952026-03-03T16:56:45.529ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e1449a7-960e-496d-b78a-6f4287f02eaa", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
21962026-03-03T16:56:45.529ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cmpa
21972026-03-03T16:56:45.529ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
21982026-03-03T16:56:45.529ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
21992026-03-03T16:56:45.530ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22002026-03-03T16:56:45.531ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "91fc7724-e169-4cb1-aecd-348ea949f307", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22012026-03-03T16:56:45.531ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
22022026-03-03T16:56:45.532ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22032026-03-03T16:56:45.532ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22042026-03-03T16:56:45.532ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22052026-03-03T16:56:45.533ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c08854c2-7bc5-40c7-abcf-b58c44ddc680", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22062026-03-03T16:56:45.533ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
22072026-03-03T16:56:45.534ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
22082026-03-03T16:56:45.534ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
22092026-03-03T16:56:45.534ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22102026-03-03T16:56:45.534ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22112026-03-03T16:56:45.534ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22122026-03-03T16:56:45.541ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b29d228f-ddad-42a0-9a03-b9167e68333e", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22132026-03-03T16:56:45.541ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
22142026-03-03T16:56:45.541ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
22152026-03-03T16:56:45.541ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22162026-03-03T16:56:45.541ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22172026-03-03T16:56:45.541ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22182026-03-03T16:56:45.541ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6c175cf-ac7f-4f70-81df-aa1d50a11ce2", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22192026-03-03T16:56:45.541ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0
22202026-03-03T16:56:45.541ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "144035e7-728f-4f90-acf4-8d114d8fef34", "content-length": "723", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22212026-03-03T16:56:45.541ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/active-slot
22222026-03-03T16:56:45.541ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22232026-03-03T16:56:45.541ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22242026-03-03T16:56:45.541ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22252026-03-03T16:56:45.541ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22262026-03-03T16:56:45.541ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "5943fc8f-cf6a-4c38-90d9-2749a600d0c4", "content-length": "10", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22272026-03-03T16:56:45.541ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/0
22282026-03-03T16:56:45.541ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22292026-03-03T16:56:45.547ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
22302026-03-03T16:56:45.547ZTRACtest_metrics (InternalApi): successful lookup of siloed resource "Vpc" using built-in user
22312026-03-03T16:56:45.547ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22322026-03-03T16:56:45.547ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22332026-03-03T16:56:45.547ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22342026-03-03T16:56:45.548ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9045bb2-43be-43a6-acdd-399f09a62f53", "content-length": "144", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22352026-03-03T16:56:45.548ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/1
22362026-03-03T16:56:45.549ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22372026-03-03T16:56:45.549ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22382026-03-03T16:56:45.549ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22392026-03-03T16:56:45.550ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b562422-7641-4f80-8004-6835a7648340", "content-length": "147", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22402026-03-03T16:56:45.550ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=0
22412026-03-03T16:56:45.551ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22422026-03-03T16:56:45.551ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22432026-03-03T16:56:45.552ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22442026-03-03T16:56:45.556ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "274dfd20-7ca1-4746-82ad-1c4a0d53aa30", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22452026-03-03T16:56:45.556ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=1
22462026-03-03T16:56:45.557ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22472026-03-03T16:56:45.557ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22482026-03-03T16:56:45.557ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22492026-03-03T16:56:45.559ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "eed3a472-4979-4436-aaa4-bee395c5c91c", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22502026-03-03T16:56:45.559ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=0
22512026-03-03T16:56:45.559ZTRACtest_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
22522026-03-03T16:56:45.559ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
22532026-03-03T16:56:45.559ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22542026-03-03T16:56:45.559ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22552026-03-03T16:56:45.560ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22562026-03-03T16:56:45.561ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "595b3a9b-0de2-48fd-a07f-eed6949b55ce", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22572026-03-03T16:56:45.561ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=1
22582026-03-03T16:56:45.561ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
22592026-03-03T16:56:45.561ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22602026-03-03T16:56:45.561ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22612026-03-03T16:56:45.562ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22622026-03-03T16:56:45.571ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "964cbff1-22fb-410b-bb05-9b149a98d507", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22632026-03-03T16:56:45.571ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=0
22642026-03-03T16:56:45.571ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22652026-03-03T16:56:45.571ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22662026-03-03T16:56:45.571ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22672026-03-03T16:56:45.571ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22682026-03-03T16:56:45.571ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22692026-03-03T16:56:45.572ZDEBGtest_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
22702026-03-03T16:56:45.572ZTRACtest_metrics (InternalApi): successful lookup of siloed resource "VpcSubnet" using built-in user
22712026-03-03T16:56:45.572ZTRACtest_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
22722026-03-03T16:56:45.572ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
22732026-03-03T16:56:45.572ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22742026-03-03T16:56:45.572ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22752026-03-03T16:56:45.572ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22762026-03-03T16:56:45.574ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "211b4e0a-a304-43b8-b402-377200bbc0ee", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22772026-03-03T16:56:45.574ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=1
22782026-03-03T16:56:45.575ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
22792026-03-03T16:56:45.575ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22802026-03-03T16:56:45.575ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22812026-03-03T16:56:45.575ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22822026-03-03T16:56:45.577ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22832026-03-03T16:56:45.577ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22842026-03-03T16:56:45.577ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22852026-03-03T16:56:45.577ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22862026-03-03T16:56:45.578ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "25270a36-d28f-4d80-aa40-b4fd44537781", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22872026-03-03T16:56:45.578ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cmpa
22882026-03-03T16:56:45.578ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b489b745-dcc4-4a71-ace9-ba15db3a388f", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22892026-03-03T16:56:45.579ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
22902026-03-03T16:56:45.579ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22912026-03-03T16:56:45.585ZDEBGtest_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
22922026-03-03T16:56:45.585ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
22932026-03-03T16:56:45.585ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
22942026-03-03T16:56:45.585ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
22952026-03-03T16:56:45.586ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccc7b244-1a16-4906-8fb7-62fc2b0e4aeb", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22962026-03-03T16:56:45.587ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
22972026-03-03T16:56:45.587ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "18f90c1b-4da2-45c7-b5fd-ef27cba7b167", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
22982026-03-03T16:56:45.587ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
22992026-03-03T16:56:45.588ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "24d52def-a27a-4133-81eb-461dd3b03480", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23002026-03-03T16:56:45.588ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1
23012026-03-03T16:56:45.588ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23022026-03-03T16:56:45.588ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23032026-03-03T16:56:45.589ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23042026-03-03T16:56:45.590ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6896434-c4a7-4347-b5de-7bd268df0e65", "content-length": "723", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23052026-03-03T16:56:45.590ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/active-slot
23062026-03-03T16:56:45.590ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23072026-03-03T16:56:45.590ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23082026-03-03T16:56:45.591ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23092026-03-03T16:56:45.592ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ae89658-88db-46b0-a8c0-951c9a1c900a", "content-length": "10", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23102026-03-03T16:56:45.592ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/0
23112026-03-03T16:56:45.593ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23122026-03-03T16:56:45.593ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23132026-03-03T16:56:45.593ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23142026-03-03T16:56:45.594ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c316f0c6-1c09-4d31-b63e-753b2c0bb57f", "content-length": "144", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23152026-03-03T16:56:45.595ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/1
23162026-03-03T16:56:45.595ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7a2c2ef-3e1c-4789-a294-bd5cd941d107", "content-length": "147", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23172026-03-03T16:56:45.595ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=0
23182026-03-03T16:56:45.596ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd461f30-7497-4347-b68d-e1f1d70b5112", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23192026-03-03T16:56:45.596ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=1
23202026-03-03T16:56:45.597ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1d376c9-37fd-413f-94d6-5cee1d7566bf", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23212026-03-03T16:56:45.597ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=0
23222026-03-03T16:56:45.597ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8546c67-cd4e-4779-ab04-d638ec670a03", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23232026-03-03T16:56:45.597ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=1
23242026-03-03T16:56:45.598ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d6def08-1bb4-42ae-b61d-a088e9086364", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23252026-03-03T16:56:45.598ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=0
23262026-03-03T16:56:45.599ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23272026-03-03T16:56:45.599ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23282026-03-03T16:56:45.600ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23292026-03-03T16:56:45.600ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7205f021-7e05-4858-86ea-768079499b1d", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23302026-03-03T16:56:45.600ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=1
23312026-03-03T16:56:45.602ZTRACtest_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
23322026-03-03T16:56:45.602ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
23332026-03-03T16:56:45.602ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23342026-03-03T16:56:45.602ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23352026-03-03T16:56:45.602ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23362026-03-03T16:56:45.606ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "671846d6-d5b7-4bc1-a18d-ff425375090e", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23372026-03-03T16:56:45.606ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cmpa
23382026-03-03T16:56:45.606ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
23392026-03-03T16:56:45.606ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23402026-03-03T16:56:45.606ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23412026-03-03T16:56:45.606ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23422026-03-03T16:56:45.607ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e26354e-683c-4129-84b3-14f835b08df6", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23432026-03-03T16:56:45.608ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
23442026-03-03T16:56:45.608ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23452026-03-03T16:56:45.608ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23462026-03-03T16:56:45.608ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23472026-03-03T16:56:45.612ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23482026-03-03T16:56:45.612ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0c5cb5e-602c-4a4d-a924-ca67351b8593", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23492026-03-03T16:56:45.613ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
23502026-03-03T16:56:45.613ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23512026-03-03T16:56:45.619ZDEBGtest_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
23522026-03-03T16:56:45.619ZTRACtest_metrics (InternalApi): successful lookup of siloed resource "VpcSubnet" using built-in user
23532026-03-03T16:56:45.619ZTRACtest_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
23542026-03-03T16:56:45.619ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
23552026-03-03T16:56:45.619ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23562026-03-03T16:56:45.619ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23572026-03-03T16:56:45.620ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23582026-03-03T16:56:45.621ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf7c8def-da12-4bbe-9d06-7839c4647661", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23592026-03-03T16:56:45.621ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
23602026-03-03T16:56:45.622ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
23612026-03-03T16:56:45.622ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23622026-03-03T16:56:45.622ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23632026-03-03T16:56:45.622ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23642026-03-03T16:56:45.623ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23652026-03-03T16:56:45.623ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23662026-03-03T16:56:45.623ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23672026-03-03T16:56:45.624ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23682026-03-03T16:56:45.626ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c236e1e-1f3b-400a-9972-9cb18300e6b4", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
23692026-03-03T16:56:45.626ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
23702026-03-03T16:56:45.626ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23712026-03-03T16:56:45.626ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
23722026-03-03T16:56:45.626ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23732026-03-03T16:56:45.626ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
23742026-03-03T16:56:45.627ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23752026-03-03T16:56:45.633ZDEBGtest_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
23762026-03-03T16:56:45.633ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23772026-03-03T16:56:45.633ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23782026-03-03T16:56:45.633ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
23792026-03-03T16:56:45.634ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23802026-03-03T16:56:45.637ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
23812026-03-03T16:56:45.637ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
23822026-03-03T16:56:45.637ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23832026-03-03T16:56:45.637ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
23842026-03-03T16:56:45.637ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23852026-03-03T16:56:45.637ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
23862026-03-03T16:56:45.639ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23872026-03-03T16:56:45.642ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
23882026-03-03T16:56:45.642ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
23892026-03-03T16:56:45.642ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23902026-03-03T16:56:45.642ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
23912026-03-03T16:56:45.654ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:33115
23922026-03-03T16:56:45.654ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:33115 background_task = inventory_collection body = None method = GET uri = http://[::1]:33115/inventory
23932026-03-03T16:56:45.655ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47668 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
23942026-03-03T16:56:45.655ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = GET remote_addr = [::1]:47668 req_id = cbc394d0-bdbc-4d01-9a8d-168ca9ec957b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
23952026-03-03T16:56:45.655ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = GET remote_addr = [::1]:47668 req_id = cbc394d0-bdbc-4d01-9a8d-168ca9ec957b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
23962026-03-03T16:56:45.656ZINFOtest_metrics (dropshot): request completed latency_us = 1108 local_addr = [::1]:33115 method = GET remote_addr = [::1]:47668 req_id = cbc394d0-bdbc-4d01-9a8d-168ca9ec957b response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
23972026-03-03T16:56:45.657ZDEBGtest_metrics (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 4f68e36a-4b67-402a-8cb2-f637a7df6d1e, kind: Service { id: 913233fe-92a8-4635-9572-183f495429c4 }, name: Name("nexus-913233fe-92a8-4635-9572-183f495429c4"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), vni: Vni(100), primary: true, slot: 0 }], Name("external-dns"): [NetworkInterface { id: a6ffa587-24d3-4dcb-8c2c-e56a629ab6ed, kind: Service { id: 9f9be08c-87bc-4246-a3f7-f9772fad7223 }, name: Name("external-dns-9f9be08c-87bc-4246-a3f7-f9772fad7223"), ip_config: V6(PrivateIpv6Config { ip: fd77:e9d2:9cd9:1::6, subnet: Ipv6Net { addr: fd77:e9d2:9cd9:1::, width: 64 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
23982026-03-03T16:56:45.657ZTRACtest_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
23992026-03-03T16:56:45.657ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
24002026-03-03T16:56:45.657ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24012026-03-03T16:56:45.657ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24022026-03-03T16:56:45.657ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24032026-03-03T16:56:45.658ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:33115 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:33115/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbc394d0-bdbc-4d01-9a8d-168ca9ec957b", "content-length": "20607", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
24042026-03-03T16:56:45.659ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
24052026-03-03T16:56:45.659ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
24062026-03-03T16:56:45.659ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
24072026-03-03T16:56:45.659ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
24082026-03-03T16:56:45.660ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
24092026-03-03T16:56:45.660ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
24102026-03-03T16:56:45.668ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 00202f40-5fe9-436d-80ec-5125a4b6d9f1 (omicron_zone)
24112026-03-03T16:56:45.669ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
24122026-03-03T16:56:45.669ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
24132026-03-03T16:56:45.669ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
24142026-03-03T16:56:45.678ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 5af26469-64ce-4f90-bbd5-93c35e3638d1 (omicron_zone)
24152026-03-03T16:56:45.678ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:43957 method = GET uri = http://[::1]:43957/config
24162026-03-03T16:56:45.678ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24172026-03-03T16:56:45.681ZDEBGtest_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
24182026-03-03T16:56:45.681ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24192026-03-03T16:56:45.681ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24202026-03-03T16:56:45.681ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24212026-03-03T16:56:45.682ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:43957 remote_addr = [::1]:55842
24222026-03-03T16:56:45.682ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:43957 method = GET remote_addr = [::1]:55842 req_id = 92aa0add-77f5-485a-8cd0-65a6e13ee178 uri = /config
24232026-03-03T16:56:45.682ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:43957 method = GET remote_addr = [::1]:55842 req_id = 92aa0add-77f5-485a-8cd0-65a6e13ee178 uri = /config version = 2.0.0
24242026-03-03T16:56:45.683ZINFOtest_metrics (http): request completed kind = dns latency_us = 587 local_addr = [::1]:43957 method = GET remote_addr = [::1]:55842 req_id = 92aa0add-77f5-485a-8cd0-65a6e13ee178 response_code = 200 uri = /config
24252026-03-03T16:56:45.683ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:43957 result = Ok(Response { url: "http://[::1]:43957/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "92aa0add-77f5-485a-8cd0-65a6e13ee178", "content-length": "3478", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
24262026-03-03T16:56:45.683ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 5af26469-64ce-4f90-bbd5-93c35e3638d1 (omicron_zone)
24272026-03-03T16:56:45.683ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
24282026-03-03T16:56:45.683ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
24292026-03-03T16:56:45.683ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
24302026-03-03T16:56:45.683ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
24312026-03-03T16:56:45.683ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
24322026-03-03T16:56:45.684ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24332026-03-03T16:56:45.684ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
24342026-03-03T16:56:45.685ZTRACtest_metrics (InternalApi): fetched allowlist from DB allowed = AllowList { id: 001de000-a110-4000-8000-000000000000, time_created: 2026-03-03T16:36:34.361106Z, time_modified: 2026-03-03T16:56:45.191480Z, allowed_ips: None }
24352026-03-03T16:56:45.685ZDEBGtest_metrics (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
24362026-03-03T16:56:45.685ZDEBGtest_metrics (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a6ffa587-24d3-4dcb-8c2c-e56a629ab6ed, kind: Service { id: 9f9be08c-87bc-4246-a3f7-f9772fad7223 }, name: Name("external-dns-9f9be08c-87bc-4246-a3f7-f9772fad7223"), ip_config: V6(PrivateIpv6Config { ip: fd77:e9d2:9cd9:1::6, subnet: Ipv6Net { addr: fd77:e9d2:9cd9:1::, width: 64 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f68e36a-4b67-402a-8cb2-f637a7df6d1e, kind: Service { id: 913233fe-92a8-4635-9572-183f495429c4 }, name: Name("nexus-913233fe-92a8-4635-9572-183f495429c4"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a6ffa587-24d3-4dcb-8c2c-e56a629ab6ed, kind: Service { id: 9f9be08c-87bc-4246-a3f7-f9772fad7223 }, name: Name("external-dns-9f9be08c-87bc-4246-a3f7-f9772fad7223"), ip_config: V6(PrivateIpv6Config { ip: fd77:e9d2:9cd9:1::6, subnet: Ipv6Net { addr: fd77:e9d2:9cd9:1::, width: 64 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f68e36a-4b67-402a-8cb2-f637a7df6d1e, kind: Service { id: 913233fe-92a8-4635-9572-183f495429c4 }, name: Name("nexus-913233fe-92a8-4635-9572-183f495429c4"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
24372026-03-03T16:56:45.685ZDEBGtest_metrics (InternalApi): resolved 3 rules for sleds
24382026-03-03T16:56:45.687ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24392026-03-03T16:56:45.689ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
24402026-03-03T16:56:45.690ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
24412026-03-03T16:56:45.690ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24422026-03-03T16:56:45.690ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
24432026-03-03T16:56:45.727ZDEBGtest_metrics (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: b6d65341-167c-41df-9b5c-41cded99c229 (sled), time_created: 2026-03-03T16:56:43.433035Z, time_modified: 2026-03-03T16:56:43.433035Z }, time_deleted: None, rcgen: Generation(Generation(1)), rack_id: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, is_scrimlet: true, serial_number: "SimGimlet00", part_number: "i86pc", revision: SqlU32(3), usable_hardware_threads: SqlU32(16), usable_physical_ram: ByteCount(ByteCount(34359738368)), reservoir_size: ByteCount(ByteCount(17179869184)), ip: ::1, port: SqlU16(33115), last_used_address: ::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(33671), cpu_family: AmdMilan }]
24442026-03-03T16:56:45.727ZDEBGtest_metrics (InternalApi): sending firewall rules to sled agents
24452026-03-03T16:56:45.738ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24462026-03-03T16:56:45.738ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24472026-03-03T16:56:45.738ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24482026-03-03T16:56:45.744ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
24492026-03-03T16:56:45.744ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
24502026-03-03T16:56:45.744ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24512026-03-03T16:56:45.744ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24522026-03-03T16:56:45.744ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24532026-03-03T16:56:45.753ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24542026-03-03T16:56:45.757ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
24552026-03-03T16:56:45.758ZDEBGtest_metrics (InternalApi): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:33115/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24562026-03-03T16:56:45.759ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47670 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
24572026-03-03T16:56:45.759ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47670 req_id = d35b1574-bfd0-42cc-ac6e-872bd87c0569 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24582026-03-03T16:56:45.759ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47670 req_id = d35b1574-bfd0-42cc-ac6e-872bd87c0569 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules version = 23.0.0
24592026-03-03T16:56:45.760ZINFOtest_metrics (dropshot): request completed latency_us = 679 local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47670 req_id = d35b1574-bfd0-42cc-ac6e-872bd87c0569 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24602026-03-03T16:56:45.760ZDEBGtest_metrics (InternalApi): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:33115/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "d35b1574-bfd0-42cc-ac6e-872bd87c0569", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
24612026-03-03T16:56:45.760ZINFOtest_metrics (InternalApi): updated firewall rules on 1 sleds
24622026-03-03T16:56:45.760ZINFOtest_metrics (nexus): plumbed initial IP allowlist
24632026-03-03T16:56:45.781ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = / versions = all
24642026-03-03T16:56:45.781ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /access versions = all
24652026-03-03T16:56:45.781ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /assets/{path} versions = all
24662026-03-03T16:56:45.781ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /device/auth versions = all
24672026-03-03T16:56:45.781ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /device/confirm versions = all
24682026-03-03T16:56:45.781ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /device/success versions = all
24692026-03-03T16:56:45.781ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /device/token versions = all
24702026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /device/verify versions = all
24712026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /experimental/v1/probes versions = all starting from 2026010300.0.0
24722026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /experimental/v1/probes versions = all ending with 2026010300.0.0
24732026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /experimental/v1/probes versions = all starting from 2026010500.0.0
24742026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /experimental/v1/probes versions = all ending with 2026010500.0.0
24752026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /experimental/v1/probes/{probe} versions = all
24762026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /experimental/v1/probes/{probe} versions = all starting from 2026010300.0.0
24772026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /experimental/v1/probes/{probe} versions = all ending with 2026010300.0.0
24782026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /experimental/v1/system/support-bundles versions = all
24792026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /experimental/v1/system/support-bundles versions = all
24802026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
24812026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
24822026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
24832026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
24842026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
24852026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
24862026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
24872026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
24882026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /images versions = all
24892026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /login versions = all
24902026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /login/{silo_name}/local versions = all
24912026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
24922026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
24932026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
24942026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /lookup/{path} versions = all
24952026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /projects/{path} versions = all
24962026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /projects-new versions = all
24972026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /scim/v2/Groups versions = all
24982026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /scim/v2/Groups versions = all
24992026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /scim/v2/Groups/{group_id} versions = all
25002026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /scim/v2/Groups/{group_id} versions = all
25012026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PATCH path = /scim/v2/Groups/{group_id} versions = all
25022026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /scim/v2/Groups/{group_id} versions = all
25032026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /scim/v2/Users versions = all
25042026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /scim/v2/Users versions = all
25052026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /scim/v2/Users/{user_id} versions = all
25062026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /scim/v2/Users/{user_id} versions = all
25072026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PATCH path = /scim/v2/Users/{user_id} versions = all
25082026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /scim/v2/Users/{user_id} versions = all
25092026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /settings/{path} versions = all
25102026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /system/{path} versions = all
25112026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /utilization versions = all
25122026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/affinity-groups versions = all
25132026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/affinity-groups versions = all
25142026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
25152026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
25162026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
25172026-03-03T16:56:45.782ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
25182026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
25192026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
25202026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
25212026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/alert-classes versions = all
25222026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/alert-receivers versions = all
25232026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/alert-receivers/{receiver} versions = all
25242026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/alert-receivers/{receiver} versions = all
25252026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/alert-receivers/{receiver}/deliveries versions = all
25262026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/alert-receivers/{receiver}/probe versions = all
25272026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/alert-receivers/{receiver}/subscriptions versions = all
25282026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/alert-receivers/{receiver}/subscriptions/{subscription} versions = all
25292026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/alerts/{alert_id}/resend versions = all
25302026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/anti-affinity-groups versions = all
25312026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/anti-affinity-groups versions = all
25322026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
25332026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
25342026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
25352026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
25362026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
25372026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
25382026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
25392026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/auth-settings versions = all
25402026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/auth-settings versions = all
25412026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/certificates versions = all
25422026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/certificates versions = all
25432026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/certificates/{certificate} versions = all
25442026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/certificates/{certificate} versions = all
25452026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/disks versions = all starting from 2026013001.0.0
25462026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
25472026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/disks versions = all ending with 2025120300.0.0
25482026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/disks versions = all starting from 2026013100.0.0
25492026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/disks versions = from 2026013001.0.0 to 2026013100.0.0
25502026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
25512026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/disks versions = all ending with 2025120300.0.0
25522026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/disks/{disk} versions = all
25532026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/disks/{disk} versions = all starting from 2026013001.0.0
25542026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/disks/{disk} versions = from 2025120300.0.0 to 2026013001.0.0
25552026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/disks/{disk} versions = all ending with 2025120300.0.0
25562026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/disks/{disk}/bulk-write versions = all
25572026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
25582026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
25592026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/disks/{disk}/finalize versions = all
25602026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/external-subnets versions = all starting from 2026011601.0.0
25612026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/external-subnets versions = all starting from 2026012201.0.0
25622026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/external-subnets versions = from 2026011601.0.0 to 2026012201.0.0
25632026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
25642026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
25652026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
25662026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/external-subnets/{external_subnet}/attach versions = all starting from 2026011601.0.0
25672026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/external-subnets/{external_subnet}/detach versions = all starting from 2026011601.0.0
25682026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/floating-ips versions = all
25692026-03-03T16:56:45.783ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/floating-ips versions = all starting from 2026012200.0.0
25702026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/floating-ips versions = from 2026011600.0.0 to 2026012200.0.0
25712026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/floating-ips versions = from 2026010500.0.0 to 2026011600.0.0
25722026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/floating-ips versions = from 2025122300.0.0 to 2026010500.0.0
25732026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/floating-ips versions = all ending with 2025122300.0.0
25742026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
25752026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/floating-ips/{floating_ip} versions = all
25762026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
25772026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
25782026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
25792026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/groups versions = all
25802026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/groups/{group_id} versions = all
25812026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/images versions = all
25822026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/images versions = all
25832026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/images/{image} versions = all
25842026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/images/{image} versions = all
25852026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/images/{image}/demote versions = all
25862026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/images/{image}/promote versions = all
25872026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances versions = all
25882026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances versions = all starting from 2026013100.0.0
25892026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances versions = from 2026013001.0.0 to 2026013100.0.0
25902026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances versions = from 2026010800.0.0 to 2026013001.0.0
25912026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances versions = from 2026010500.0.0 to 2026010800.0.0
25922026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances versions = from 2026010300.0.0 to 2026010500.0.0
25932026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances versions = from 2025122300.0.0 to 2026010300.0.0
25942026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances versions = from 2025120300.0.0 to 2025122300.0.0
25952026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances versions = all ending with 2025120300.0.0
25962026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/instances/{instance} versions = all
25972026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance} versions = all
25982026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/instances/{instance} versions = all starting from 2026010800.0.0
25992026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/instances/{instance} versions = all ending with 2026010800.0.0
26002026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/affinity-groups versions = all
26012026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/anti-affinity-groups versions = all
26022026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/disks versions = all starting from 2026013001.0.0
26032026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/disks versions = from 2025120300.0.0 to 2026013001.0.0
26042026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/disks versions = all ending with 2025120300.0.0
26052026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/disks/attach versions = all starting from 2026013001.0.0
26062026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/disks/attach versions = from 2025120300.0.0 to 2026013001.0.0
26072026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/disks/attach versions = all ending with 2025120300.0.0
26082026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/disks/detach versions = all starting from 2026013001.0.0
26092026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/disks/detach versions = from 2025120300.0.0 to 2026013001.0.0
26102026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/disks/detach versions = all ending with 2025120300.0.0
26112026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/external-ips versions = all
26122026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026012300.0.0
26132026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2026012300.0.0
26142026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026010500.0.0
26152026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = from 2025122300.0.0 to 2026010500.0.0
26162026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2025122300.0.0
26172026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/external-subnets versions = all starting from 2026013000.0.0
26182026-03-03T16:56:45.784ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/multicast-groups versions = all starting from 2026010800.0.0
26192026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/multicast-groups versions = all ending with 2026010800.0.0
26202026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
26212026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
26222026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
26232026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
26242026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/reboot versions = all
26252026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/serial-console versions = all
26262026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
26272026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
26282026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/start versions = all
26292026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/instances/{instance}/stop versions = all
26302026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/internet-gateway-ip-addresses versions = all
26312026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/internet-gateway-ip-addresses versions = all
26322026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
26332026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/internet-gateway-ip-pools versions = all
26342026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/internet-gateway-ip-pools versions = all
26352026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
26362026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/internet-gateways versions = all
26372026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/internet-gateways versions = all
26382026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
26392026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/internet-gateways/{gateway} versions = all
26402026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/ip-pools versions = all starting from 2026020900.0.0
26412026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/ip-pools versions = from 2026010100.0.0 to 2026020900.0.0
26422026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/ip-pools versions = all ending with 2026010100.0.0
26432026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/ip-pools/{pool} versions = all starting from 2026020900.0.0
26442026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/ip-pools/{pool} versions = from 2026010100.0.0 to 2026020900.0.0
26452026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/ip-pools/{pool} versions = all ending with 2026010100.0.0
26462026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/login/{silo_name}/local versions = all
26472026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/logout versions = all
26482026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/me versions = all
26492026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/me/access-tokens versions = all
26502026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/me/access-tokens/{token_id} versions = all
26512026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/me/groups versions = all
26522026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/me/ssh-keys versions = all
26532026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/me/ssh-keys versions = all
26542026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
26552026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
26562026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/metrics/{metric_name} versions = all
26572026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/multicast-groups versions = all starting from 2026010800.0.0
26582026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/multicast-groups versions = all ending with 2026010800.0.0
26592026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/multicast-groups versions = all ending with 2026010800.0.0
26602026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
26612026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
26622026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
26632026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
26642026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all starting from 2026010800.0.0
26652026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
26662026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
26672026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/multicast-groups/{multicast_group}/members/{instance} versions = all ending with 2026010800.0.0
26682026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/network-interfaces versions = all starting from 2026010300.0.0
26692026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/network-interfaces versions = all ending with 2026010300.0.0
26702026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/network-interfaces versions = all starting from 2026010300.0.0
26712026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/network-interfaces versions = all ending with 2026010300.0.0
26722026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/network-interfaces/{interface} versions = all
26732026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
26742026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
26752026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
26762026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
26772026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/ping versions = all
26782026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/policy versions = all
26792026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/policy versions = all
26802026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/projects versions = all
26812026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/projects versions = all
26822026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/projects/{project} versions = all
26832026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/projects/{project} versions = all
26842026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/projects/{project} versions = all
26852026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/projects/{project}/policy versions = all
26862026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/projects/{project}/policy versions = all
26872026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/snapshots versions = all
26882026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/snapshots versions = all
26892026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/snapshots/{snapshot} versions = all
26902026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/snapshots/{snapshot} versions = all
26912026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/subnet-pools versions = all starting from 2026020900.0.0
26922026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/subnet-pools versions = from 2026020600.0.0 to 2026020900.0.0
26932026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/subnet-pools/{pool} versions = all starting from 2026020900.0.0
26942026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/audit-log versions = all
26952026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/disks versions = all
26962026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
26972026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
26982026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/racks versions = all
26992026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
27002026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/racks/{rack_id}/membership versions = all starting from 2026012100.0.0
27012026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/abort versions = all starting from 2026020200.0.0
27022026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/add versions = all starting from 2026012100.0.0
27032026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/sleds versions = all
27042026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/hardware/sleds versions = all ending with 2026021900.0.0
27052026-03-03T16:56:45.785ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
27062026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
27072026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
27082026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
27092026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
27102026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/switch-port versions = all
27112026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
27122026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
27132026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
27142026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
27152026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
27162026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/switches versions = all
27172026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
27182026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/identity-providers versions = all
27192026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/identity-providers/local/users versions = all
27202026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
27212026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
27222026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/identity-providers/saml versions = all
27232026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
27242026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
27252026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
27262026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
27272026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
27282026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
27292026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
27302026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
27312026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
27322026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
27332026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
27342026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all starting from 2026020900.0.0
27352026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all ending with 2026020900.0.0
27362026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all starting from 2026020900.0.0
27372026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all ending with 2026020900.0.0
27382026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all starting from 2026020900.0.0
27392026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all ending with 2026020900.0.0
27402026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
27412026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
27422026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
27432026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
27442026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
27452026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
27462026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
27472026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
27482026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all starting from 2026020900.0.0
27492026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all ending with 2026020900.0.0
27502026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools-service versions = all starting from 2026020900.0.0
27512026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools-service versions = all ending with 2026020900.0.0
27522026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools-service/ranges versions = all starting from 2026020900.0.0
27532026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/ip-pools-service/ranges versions = all ending with 2026020900.0.0
27542026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all starting from 2026020900.0.0
27552026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all ending with 2026020900.0.0
27562026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all starting from 2026020900.0.0
27572026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all ending with 2026020900.0.0
27582026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/metrics/{metric_name} versions = all
27592026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/multicast-groups/by-ip/{address} versions = all ending with 2026010800.0.0
27602026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/address-lot versions = all
27612026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/networking/address-lot versions = all
27622026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
27632026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/address-lot/{address_lot} versions = all
27642026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
27652026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/allow-list versions = all
27662026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/networking/allow-list versions = all
27672026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/networking/bfd-disable versions = all
27682026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/networking/bfd-enable versions = all
27692026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bfd-status versions = all
27702026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/networking/bgp versions = all
27712026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
27722026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
27732026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
27742026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
27752026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp-announce-set versions = all
27762026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
27772026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
27782026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
27792026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp-exported versions = all starting from 2026021301.0.0
27802026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp-exported versions = all ending with 2026021301.0.0
27812026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp-imported versions = all starting from 2026021301.0.0
27822026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp-message-history versions = all
27832026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all ending with 2026021301.0.0
27842026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp-status versions = all starting from 2026021301.0.0
27852026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp-status versions = from 2025121200.0.0 to 2026021301.0.0
27862026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/bgp-status versions = all ending with 2025121200.0.0
27872026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/inbound-icmp versions = all
27882026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/networking/inbound-icmp versions = all
27892026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/loopback-address versions = all
27902026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/networking/loopback-address versions = all
27912026-03-03T16:56:45.786ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
27922026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
27932026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/switch-port-settings versions = all
27942026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/networking/switch-port-settings versions = all starting from 2026021301.0.0
27952026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/networking/switch-port-settings versions = all ending with 2026021301.0.0
27962026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all starting from 2026021301.0.0
27972026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all ending with 2026021301.0.0
27982026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/policy versions = all
27992026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/policy versions = all
28002026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/scim/tokens versions = all
28012026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/scim/tokens versions = all
28022026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/scim/tokens/{token_id} versions = all
28032026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/scim/tokens/{token_id} versions = all
28042026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/silo-quotas versions = all
28052026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/silos versions = all
28062026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/silos versions = all
28072026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/silos/{silo} versions = all
28082026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/silos/{silo} versions = all
28092026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all starting from 2026010100.0.0
28102026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all ending with 2026010100.0.0
28112026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/silos/{silo}/policy versions = all
28122026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/silos/{silo}/policy versions = all
28132026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/silos/{silo}/quotas versions = all
28142026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
28152026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/silos/{silo}/subnet-pools versions = all starting from 2026020600.0.0
28162026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
28172026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
28182026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012800.0.0
28192026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
28202026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
28212026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools versions = from 2026012201.0.0 to 2026012800.0.0
28222026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012201.0.0
28232026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
28242026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026020900.0.0
28252026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
28262026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
28272026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
28282026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
28292026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
28302026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
28312026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools/{pool}/members versions = all starting from 2026020900.0.0
28322026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026012800.0.0 to 2026020900.0.0
28332026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026011601.0.0 to 2026012800.0.0
28342026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = all starting from 2026020900.0.0
28352026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012800.0.0 to 2026020900.0.0
28362026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012201.0.0 to 2026012800.0.0
28372026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026011601.0.0 to 2026012201.0.0
28382026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = all starting from 2026020900.0.0
28392026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = from 2026011601.0.0 to 2026020900.0.0
28402026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
28412026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
28422026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
28432026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
28442026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
28452026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
28462026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
28472026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
28482026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = all starting from 2026020900.0.0
28492026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = from 2026011601.0.0 to 2026020900.0.0
28502026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/timeseries/query versions = all
28512026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/timeseries/schemas versions = all
28522026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/update/repositories versions = all
28532026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/update/repositories versions = all
28542026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/update/repositories/{system_version} versions = all
28552026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/update/status versions = all
28562026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/system/update/target-release versions = all
28572026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/update/trust-roots versions = all
28582026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/system/update/trust-roots versions = all
28592026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/system/update/trust-roots/{trust_root_id} versions = all
28602026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/update/trust-roots/{trust_root_id} versions = all
28612026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/users versions = all
28622026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/users/{user_id} versions = all
28632026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/users-builtin versions = all
28642026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/users-builtin/{user} versions = all
28652026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/utilization/silos versions = all
28662026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/system/utilization/silos/{silo} versions = all
28672026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/timeseries/query versions = all
28682026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/users versions = all
28692026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/users/{user_id} versions = all
28702026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/users/{user_id}/access-tokens versions = all
28712026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/users/{user_id}/logout versions = all
28722026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/users/{user_id}/sessions versions = all
28732026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/utilization versions = all
28742026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpc-firewall-rules versions = all
28752026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/vpc-firewall-rules versions = all
28762026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpc-router-routes versions = all
28772026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/vpc-router-routes versions = all
28782026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
28792026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpc-router-routes/{route} versions = all
28802026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/vpc-router-routes/{route} versions = all
28812026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpc-routers versions = all
28822026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/vpc-routers versions = all
28832026-03-03T16:56:45.787ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/vpc-routers/{router} versions = all
28842026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpc-routers/{router} versions = all
28852026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/vpc-routers/{router} versions = all
28862026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpc-subnets versions = all
28872026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/vpc-subnets versions = all
28882026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
28892026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpc-subnets/{subnet} versions = all
28902026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
28912026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all starting from 2026010300.0.0
28922026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all ending with 2026010300.0.0
28932026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpcs versions = all
28942026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/vpcs versions = all
28952026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/vpcs/{vpc} versions = all
28962026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/vpcs/{vpc} versions = all
28972026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/vpcs/{vpc} versions = all
28982026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/webhook-receivers versions = all
28992026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = PUT path = /v1/webhook-receivers/{receiver} versions = all
29002026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = GET path = /v1/webhook-secrets versions = all
29012026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = POST path = /v1/webhook-secrets versions = all
29022026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:40151 method = DELETE path = /v1/webhook-secrets/{secret_id} versions = all
29032026-03-03T16:56:45.788ZINFOtest_metrics (dropshot_external): listening local_addr = 127.0.0.1:40151
29042026-03-03T16:56:45.788ZDEBGtest_metrics (dropshot_external): successfully registered DTrace USDT probes local_addr = 127.0.0.1:40151
29052026-03-03T16:56:45.806ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = / versions = all
29062026-03-03T16:56:45.806ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /access versions = all
29072026-03-03T16:56:45.806ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /assets/{path} versions = all
29082026-03-03T16:56:45.806ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /device/auth versions = all
29092026-03-03T16:56:45.806ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /device/confirm versions = all
29102026-03-03T16:56:45.806ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /device/success versions = all
29112026-03-03T16:56:45.806ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /device/token versions = all
29122026-03-03T16:56:45.806ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /device/verify versions = all
29132026-03-03T16:56:45.806ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /experimental/v1/probes versions = all starting from 2026010300.0.0
29142026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /experimental/v1/probes versions = all ending with 2026010300.0.0
29152026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /experimental/v1/probes versions = all starting from 2026010500.0.0
29162026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /experimental/v1/probes versions = all ending with 2026010500.0.0
29172026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /experimental/v1/probes/{probe} versions = all
29182026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /experimental/v1/probes/{probe} versions = all starting from 2026010300.0.0
29192026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /experimental/v1/probes/{probe} versions = all ending with 2026010300.0.0
29202026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /experimental/v1/system/support-bundles versions = all
29212026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /experimental/v1/system/support-bundles versions = all
29222026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
29232026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
29242026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
29252026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
29262026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
29272026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
29282026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
29292026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
29302026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /images versions = all
29312026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /login versions = all
29322026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /login/{silo_name}/local versions = all
29332026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
29342026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
29352026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
29362026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /lookup/{path} versions = all
29372026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /projects/{path} versions = all
29382026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /projects-new versions = all
29392026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /scim/v2/Groups versions = all
29402026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /scim/v2/Groups versions = all
29412026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /scim/v2/Groups/{group_id} versions = all
29422026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /scim/v2/Groups/{group_id} versions = all
29432026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PATCH path = /scim/v2/Groups/{group_id} versions = all
29442026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /scim/v2/Groups/{group_id} versions = all
29452026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /scim/v2/Users versions = all
29462026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /scim/v2/Users versions = all
29472026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /scim/v2/Users/{user_id} versions = all
29482026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /scim/v2/Users/{user_id} versions = all
29492026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PATCH path = /scim/v2/Users/{user_id} versions = all
29502026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /scim/v2/Users/{user_id} versions = all
29512026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /settings/{path} versions = all
29522026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /system/{path} versions = all
29532026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /utilization versions = all
29542026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/affinity-groups versions = all
29552026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/affinity-groups versions = all
29562026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
29572026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
29582026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
29592026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
29602026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
29612026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
29622026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
29632026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/alert-classes versions = all
29642026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/alert-receivers versions = all
29652026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/alert-receivers/{receiver} versions = all
29662026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/alert-receivers/{receiver} versions = all
29672026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/alert-receivers/{receiver}/deliveries versions = all
29682026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/alert-receivers/{receiver}/probe versions = all
29692026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/alert-receivers/{receiver}/subscriptions versions = all
29702026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/alert-receivers/{receiver}/subscriptions/{subscription} versions = all
29712026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/alerts/{alert_id}/resend versions = all
29722026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/anti-affinity-groups versions = all
29732026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/anti-affinity-groups versions = all
29742026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
29752026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
29762026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
29772026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
29782026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
29792026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
29802026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
29812026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/auth-settings versions = all
29822026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/auth-settings versions = all
29832026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/certificates versions = all
29842026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/certificates versions = all
29852026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/certificates/{certificate} versions = all
29862026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/certificates/{certificate} versions = all
29872026-03-03T16:56:45.807ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/disks versions = all starting from 2026013001.0.0
29882026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
29892026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/disks versions = all ending with 2025120300.0.0
29902026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/disks versions = all starting from 2026013100.0.0
29912026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/disks versions = from 2026013001.0.0 to 2026013100.0.0
29922026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
29932026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/disks versions = all ending with 2025120300.0.0
29942026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/disks/{disk} versions = all
29952026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/disks/{disk} versions = all starting from 2026013001.0.0
29962026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/disks/{disk} versions = from 2025120300.0.0 to 2026013001.0.0
29972026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/disks/{disk} versions = all ending with 2025120300.0.0
29982026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/disks/{disk}/bulk-write versions = all
29992026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
30002026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
30012026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/disks/{disk}/finalize versions = all
30022026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/external-subnets versions = all starting from 2026011601.0.0
30032026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/external-subnets versions = all starting from 2026012201.0.0
30042026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/external-subnets versions = from 2026011601.0.0 to 2026012201.0.0
30052026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
30062026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
30072026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
30082026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/external-subnets/{external_subnet}/attach versions = all starting from 2026011601.0.0
30092026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/external-subnets/{external_subnet}/detach versions = all starting from 2026011601.0.0
30102026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/floating-ips versions = all
30112026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/floating-ips versions = all starting from 2026012200.0.0
30122026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/floating-ips versions = from 2026011600.0.0 to 2026012200.0.0
30132026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/floating-ips versions = from 2026010500.0.0 to 2026011600.0.0
30142026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/floating-ips versions = from 2025122300.0.0 to 2026010500.0.0
30152026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/floating-ips versions = all ending with 2025122300.0.0
30162026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
30172026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/floating-ips/{floating_ip} versions = all
30182026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
30192026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
30202026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
30212026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/groups versions = all
30222026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/groups/{group_id} versions = all
30232026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/images versions = all
30242026-03-03T16:56:45.808ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/images versions = all
30252026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/images/{image} versions = all
30262026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/images/{image} versions = all
30272026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/images/{image}/demote versions = all
30282026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/images/{image}/promote versions = all
30292026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances versions = all
30302026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances versions = all starting from 2026013100.0.0
30312026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances versions = from 2026013001.0.0 to 2026013100.0.0
30322026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances versions = from 2026010800.0.0 to 2026013001.0.0
30332026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances versions = from 2026010500.0.0 to 2026010800.0.0
30342026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances versions = from 2026010300.0.0 to 2026010500.0.0
30352026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances versions = from 2025122300.0.0 to 2026010300.0.0
30362026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances versions = from 2025120300.0.0 to 2025122300.0.0
30372026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances versions = all ending with 2025120300.0.0
30382026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/instances/{instance} versions = all
30392026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance} versions = all
30402026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/instances/{instance} versions = all starting from 2026010800.0.0
30412026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/instances/{instance} versions = all ending with 2026010800.0.0
30422026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/affinity-groups versions = all
30432026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/anti-affinity-groups versions = all
30442026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/disks versions = all starting from 2026013001.0.0
30452026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/disks versions = from 2025120300.0.0 to 2026013001.0.0
30462026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/disks versions = all ending with 2025120300.0.0
30472026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/disks/attach versions = all starting from 2026013001.0.0
30482026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/disks/attach versions = from 2025120300.0.0 to 2026013001.0.0
30492026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/disks/attach versions = all ending with 2025120300.0.0
30502026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/disks/detach versions = all starting from 2026013001.0.0
30512026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/disks/detach versions = from 2025120300.0.0 to 2026013001.0.0
30522026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/disks/detach versions = all ending with 2025120300.0.0
30532026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/external-ips versions = all
30542026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026012300.0.0
30552026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2026012300.0.0
30562026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026010500.0.0
30572026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = from 2025122300.0.0 to 2026010500.0.0
30582026-03-03T16:56:45.809ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2025122300.0.0
30592026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/external-subnets versions = all starting from 2026013000.0.0
30602026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/multicast-groups versions = all starting from 2026010800.0.0
30612026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/multicast-groups versions = all ending with 2026010800.0.0
30622026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
30632026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
30642026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
30652026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
30662026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/reboot versions = all
30672026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/serial-console versions = all
30682026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
30692026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
30702026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/start versions = all
30712026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/instances/{instance}/stop versions = all
30722026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/internet-gateway-ip-addresses versions = all
30732026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/internet-gateway-ip-addresses versions = all
30742026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
30752026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/internet-gateway-ip-pools versions = all
30762026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/internet-gateway-ip-pools versions = all
30772026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
30782026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/internet-gateways versions = all
30792026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/internet-gateways versions = all
30802026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
30812026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/internet-gateways/{gateway} versions = all
30822026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/ip-pools versions = all starting from 2026020900.0.0
30832026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/ip-pools versions = from 2026010100.0.0 to 2026020900.0.0
30842026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/ip-pools versions = all ending with 2026010100.0.0
30852026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/ip-pools/{pool} versions = all starting from 2026020900.0.0
30862026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/ip-pools/{pool} versions = from 2026010100.0.0 to 2026020900.0.0
30872026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/ip-pools/{pool} versions = all ending with 2026010100.0.0
30882026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/login/{silo_name}/local versions = all
30892026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/logout versions = all
30902026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/me versions = all
30912026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/me/access-tokens versions = all
30922026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/me/access-tokens/{token_id} versions = all
30932026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/me/groups versions = all
30942026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/me/ssh-keys versions = all
30952026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/me/ssh-keys versions = all
30962026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
30972026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
30982026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/metrics/{metric_name} versions = all
30992026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/multicast-groups versions = all starting from 2026010800.0.0
31002026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/multicast-groups versions = all ending with 2026010800.0.0
31012026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/multicast-groups versions = all ending with 2026010800.0.0
31022026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
31032026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
31042026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
31052026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
31062026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all starting from 2026010800.0.0
31072026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
31082026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
31092026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/multicast-groups/{multicast_group}/members/{instance} versions = all ending with 2026010800.0.0
31102026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/network-interfaces versions = all starting from 2026010300.0.0
31112026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/network-interfaces versions = all ending with 2026010300.0.0
31122026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/network-interfaces versions = all starting from 2026010300.0.0
31132026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/network-interfaces versions = all ending with 2026010300.0.0
31142026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/network-interfaces/{interface} versions = all
31152026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
31162026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
31172026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
31182026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
31192026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/ping versions = all
31202026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/policy versions = all
31212026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/policy versions = all
31222026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/projects versions = all
31232026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/projects versions = all
31242026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/projects/{project} versions = all
31252026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/projects/{project} versions = all
31262026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/projects/{project} versions = all
31272026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/projects/{project}/policy versions = all
31282026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/projects/{project}/policy versions = all
31292026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/snapshots versions = all
31302026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/snapshots versions = all
31312026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/snapshots/{snapshot} versions = all
31322026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/snapshots/{snapshot} versions = all
31332026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/subnet-pools versions = all starting from 2026020900.0.0
31342026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/subnet-pools versions = from 2026020600.0.0 to 2026020900.0.0
31352026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/subnet-pools/{pool} versions = all starting from 2026020900.0.0
31362026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/audit-log versions = all
31372026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/disks versions = all
31382026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
31392026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
31402026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/racks versions = all
31412026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
31422026-03-03T16:56:45.810ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/racks/{rack_id}/membership versions = all starting from 2026012100.0.0
31432026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/abort versions = all starting from 2026020200.0.0
31442026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/add versions = all starting from 2026012100.0.0
31452026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/sleds versions = all
31462026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/hardware/sleds versions = all ending with 2026021900.0.0
31472026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
31482026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
31492026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
31502026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
31512026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
31522026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/switch-port versions = all
31532026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
31542026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
31552026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
31562026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
31572026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
31582026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/switches versions = all
31592026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
31602026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/identity-providers versions = all
31612026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/identity-providers/local/users versions = all
31622026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
31632026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
31642026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/identity-providers/saml versions = all
31652026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
31662026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
31672026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
31682026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
31692026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
31702026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
31712026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
31722026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
31732026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
31742026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
31752026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
31762026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all starting from 2026020900.0.0
31772026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all ending with 2026020900.0.0
31782026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all starting from 2026020900.0.0
31792026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all ending with 2026020900.0.0
31802026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all starting from 2026020900.0.0
31812026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all ending with 2026020900.0.0
31822026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
31832026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
31842026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
31852026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
31862026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
31872026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
31882026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
31892026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
31902026-03-03T16:56:45.811ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all starting from 2026020900.0.0
31912026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all ending with 2026020900.0.0
31922026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools-service versions = all starting from 2026020900.0.0
31932026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools-service versions = all ending with 2026020900.0.0
31942026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools-service/ranges versions = all starting from 2026020900.0.0
31952026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/ip-pools-service/ranges versions = all ending with 2026020900.0.0
31962026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all starting from 2026020900.0.0
31972026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all ending with 2026020900.0.0
31982026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all starting from 2026020900.0.0
31992026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all ending with 2026020900.0.0
32002026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/metrics/{metric_name} versions = all
32012026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/multicast-groups/by-ip/{address} versions = all ending with 2026010800.0.0
32022026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/address-lot versions = all
32032026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/networking/address-lot versions = all
32042026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
32052026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/address-lot/{address_lot} versions = all
32062026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
32072026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/allow-list versions = all
32082026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/networking/allow-list versions = all
32092026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/networking/bfd-disable versions = all
32102026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/networking/bfd-enable versions = all
32112026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bfd-status versions = all
32122026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/networking/bgp versions = all
32132026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
32142026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
32152026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
32162026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
32172026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp-announce-set versions = all
32182026-03-03T16:56:45.812ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
32192026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
32202026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
32212026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp-exported versions = all starting from 2026021301.0.0
32222026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp-exported versions = all ending with 2026021301.0.0
32232026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp-imported versions = all starting from 2026021301.0.0
32242026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp-message-history versions = all
32252026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all ending with 2026021301.0.0
32262026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp-status versions = all starting from 2026021301.0.0
32272026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp-status versions = from 2025121200.0.0 to 2026021301.0.0
32282026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/bgp-status versions = all ending with 2025121200.0.0
32292026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/inbound-icmp versions = all
32302026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/networking/inbound-icmp versions = all
32312026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/loopback-address versions = all
32322026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/networking/loopback-address versions = all
32332026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
32342026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
32352026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/switch-port-settings versions = all
32362026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/networking/switch-port-settings versions = all starting from 2026021301.0.0
32372026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/networking/switch-port-settings versions = all ending with 2026021301.0.0
32382026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all starting from 2026021301.0.0
32392026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all ending with 2026021301.0.0
32402026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/policy versions = all
32412026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/policy versions = all
32422026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/scim/tokens versions = all
32432026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/scim/tokens versions = all
32442026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/scim/tokens/{token_id} versions = all
32452026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/scim/tokens/{token_id} versions = all
32462026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/silo-quotas versions = all
32472026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/silos versions = all
32482026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/silos versions = all
32492026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/silos/{silo} versions = all
32502026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/silos/{silo} versions = all
32512026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all starting from 2026010100.0.0
32522026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all ending with 2026010100.0.0
32532026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/silos/{silo}/policy versions = all
32542026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/silos/{silo}/policy versions = all
32552026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/silos/{silo}/quotas versions = all
32562026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
32572026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/silos/{silo}/subnet-pools versions = all starting from 2026020600.0.0
32582026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
32592026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
32602026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012800.0.0
32612026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
32622026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
32632026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools versions = from 2026012201.0.0 to 2026012800.0.0
32642026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012201.0.0
32652026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
32662026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026020900.0.0
32672026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
32682026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
32692026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
32702026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
32712026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
32722026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
32732026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools/{pool}/members versions = all starting from 2026020900.0.0
32742026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026012800.0.0 to 2026020900.0.0
32752026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026011601.0.0 to 2026012800.0.0
32762026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = all starting from 2026020900.0.0
32772026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012800.0.0 to 2026020900.0.0
32782026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012201.0.0 to 2026012800.0.0
32792026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026011601.0.0 to 2026012201.0.0
32802026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = all starting from 2026020900.0.0
32812026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = from 2026011601.0.0 to 2026020900.0.0
32822026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
32832026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
32842026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
32852026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
32862026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
32872026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
32882026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
32892026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
32902026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = all starting from 2026020900.0.0
32912026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = from 2026011601.0.0 to 2026020900.0.0
32922026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/timeseries/query versions = all
32932026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/timeseries/schemas versions = all
32942026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/update/repositories versions = all
32952026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/update/repositories versions = all
32962026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/update/repositories/{system_version} versions = all
32972026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/update/status versions = all
32982026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/system/update/target-release versions = all
32992026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/update/trust-roots versions = all
33002026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/system/update/trust-roots versions = all
33012026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/system/update/trust-roots/{trust_root_id} versions = all
33022026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/update/trust-roots/{trust_root_id} versions = all
33032026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/users versions = all
33042026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/users/{user_id} versions = all
33052026-03-03T16:56:45.813ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/users-builtin versions = all
33062026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/users-builtin/{user} versions = all
33072026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/utilization/silos versions = all
33082026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/system/utilization/silos/{silo} versions = all
33092026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/timeseries/query versions = all
33102026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/users versions = all
33112026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/users/{user_id} versions = all
33122026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/users/{user_id}/access-tokens versions = all
33132026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/users/{user_id}/logout versions = all
33142026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/users/{user_id}/sessions versions = all
33152026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/utilization versions = all
33162026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpc-firewall-rules versions = all
33172026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/vpc-firewall-rules versions = all
33182026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpc-router-routes versions = all
33192026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/vpc-router-routes versions = all
33202026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
33212026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpc-router-routes/{route} versions = all
33222026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/vpc-router-routes/{route} versions = all
33232026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpc-routers versions = all
33242026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/vpc-routers versions = all
33252026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/vpc-routers/{router} versions = all
33262026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpc-routers/{router} versions = all
33272026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/vpc-routers/{router} versions = all
33282026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpc-subnets versions = all
33292026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/vpc-subnets versions = all
33302026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
33312026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpc-subnets/{subnet} versions = all
33322026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
33332026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all starting from 2026010300.0.0
33342026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all ending with 2026010300.0.0
33352026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpcs versions = all
33362026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/vpcs versions = all
33372026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/vpcs/{vpc} versions = all
33382026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/vpcs/{vpc} versions = all
33392026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/vpcs/{vpc} versions = all
33402026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/webhook-receivers versions = all
33412026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = PUT path = /v1/webhook-receivers/{receiver} versions = all
33422026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = GET path = /v1/webhook-secrets versions = all
33432026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = POST path = /v1/webhook-secrets versions = all
33442026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:45067 method = DELETE path = /v1/webhook-secrets/{secret_id} versions = all
33452026-03-03T16:56:45.814ZINFOtest_metrics (dropshot_external_techport): listening local_addr = 127.0.0.1:45067
33462026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = 127.0.0.1:45067
33472026-03-03T16:56:45.814ZDEBGtest_metrics (nexus-producer-server): registered DTrace probes
33482026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot): registered endpoint local_addr = 127.0.0.1:44271 method = GET path = /{producer_id} versions = all
33492026-03-03T16:56:45.814ZINFOtest_metrics (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = 127.0.0.1:44271
33502026-03-03T16:56:45.814ZDEBGtest_metrics (dropshot): successfully registered DTrace USDT probes local_addr = 127.0.0.1:44271
33512026-03-03T16:56:45.814ZDEBGtest_metrics (nexus-producer-server): Requested any available port, Dropshot server has been bound to 127.0.0.1:44271
33522026-03-03T16:56:45.814ZDEBGtest_metrics (nexus-producer-server): Nexus IP provided explicitly, will use it addr = 127.0.0.1:46333
33532026-03-03T16:56:45.814ZDEBGtest_metrics (nexus-producer-server): starting producer registration task
33542026-03-03T16:56:45.814ZINFOtest_metrics (nexus-producer-server): starting oximeter metric producer server address = 127.0.0.1:44271 file = oximeter/producer/src/lib.rs:281 interval = 10s producer_id = 913233fe-92a8-4635-9572-183f495429c4
33552026-03-03T16:56:45.814ZDEBGtest_metrics (init_with_steps): Running step start_oximeter
33562026-03-03T16:56:45.814ZDEBGtest_metrics: Starting Oximeter
33572026-03-03T16:56:45.814ZDEBGtest_metrics (oximeter): registered DTrace probes
33582026-03-03T16:56:45.814ZINFOtest_metrics (oximeter): starting oximeter server file = oximeter/collector/src/lib.rs:264
33592026-03-03T16:56:45.814ZDEBGtest_metrics (oximeter): creating ClickHouse client
33602026-03-03T16:56:45.814ZDEBGtest_metrics (clickhouse-client): registered USDT probes collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
33612026-03-03T16:56:45.814ZDEBGtest_metrics (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0
33622026-03-03T16:56:45.814ZDEBGtest_metrics (producer-registration-task): will register with Nexus at 127.0.0.1:46333
33632026-03-03T16:56:45.816ZDEBGtest_metrics (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:46333/metrics/producers
33642026-03-03T16:56:45.818ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:46333 remote_addr = 127.0.0.1:45746
33652026-03-03T16:56:45.819ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45746 req_id = 4c866500-5f4f-444f-9aa7-5c43417dc9ba uri = /metrics/producers
33662026-03-03T16:56:45.819ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45746 req_id = 4c866500-5f4f-444f-9aa7-5c43417dc9ba uri = /metrics/producers version = 1.0.0
33672026-03-03T16:56:45.820ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45746 req_id = 4c866500-5f4f-444f-9aa7-5c43417dc9ba resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
33682026-03-03T16:56:45.821ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45746 req_id = 4c866500-5f4f-444f-9aa7-5c43417dc9ba roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
33692026-03-03T16:56:45.822ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45746 req_id = 4c866500-5f4f-444f-9aa7-5c43417dc9ba resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
33702026-03-03T16:56:45.824ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = SELECT MAX(value) AS max_version FROM oximeter.version;
33712026-03-03T16:56:45.839ZWARNtest_metrics (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:900 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
33722026-03-03T16:56:45.839ZDEBGtest_metrics (oximeter-agent): oximeter database does not exist, creating collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
33732026-03-03T16:56:45.839ZINFOtest_metrics (clickhouse-client): reading db version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:800 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
33742026-03-03T16:56:45.839ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = SELECT MAX(value) AS max_version FROM oximeter.version;
33752026-03-03T16:56:45.839ZWARNtest_metrics (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:900 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
33762026-03-03T16:56:45.839ZINFOtest_metrics (clickhouse-client): read oximeter database version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:805 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 version = 0
33772026-03-03T16:56:45.839ZINFOtest_metrics (clickhouse-client): initializing oximeter schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:810 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
33782026-03-03T16:56:45.839ZDEBGtest_metrics (clickhouse-client): initializing ClickHouse database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
33792026-03-03T16:56:45.858ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = CREATE DATABASE IF NOT EXISTS oximeter
33802026-03-03T16:56:45.858ZINFOtest_metrics (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment latency_us = 37944 local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45746 req_id = 4c866500-5f4f-444f-9aa7-5c43417dc9ba response_code = 503 uri = /metrics/producers
33812026-03-03T16:56:45.858ZDEBGtest_metrics (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "4c866500-5f4f-444f-9aa7-5c43417dc9ba", "content-length": "133", "date": "Tue, 03 Mar 2026 16:56:45 GMT"} })
33822026-03-03T16:56:45.858ZWARNtest_metrics (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 50.815191ms error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "4c866500-5f4f-444f-9aa7-5c43417dc9ba", "content-length": "133", "date": "Tue, 03 Mar 2026 16:56:45 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "4c866500-5f4f-444f-9aa7-5c43417dc9ba" } file = oximeter/producer/src/lib.rs:377
33832026-03-03T16:56:45.858ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\n/* The version table contains metadata about the `oximeter` database */\nCREATE TABLE IF NOT EXISTS oximeter.version\n(\n value UInt64,\n timestamp DateTime64(9, 'UTC')\n)\nENGINE = MergeTree()\nORDER BY (value, timestamp)
33842026-03-03T16:56:45.886ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\n/* The measurement tables contain all individual samples from each timeseries.\n *\n * Each table stores a single datum type, and otherwise contains nearly the same\n * structure. The primary sorting key is on the timeseries name, key, and then\n * timestamp, so that all timeseries from the same schema are grouped, followed\n * by all samples from the same timeseries.\n *\n * This reflects that one usually looks up the _key_ in one or more field table,\n * and then uses that to index quickly into the measurements tables.\n */\nCREATE TABLE IF NOT EXISTS oximeter.measurements_bool\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Bool)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
33852026-03-03T16:56:45.904ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i8\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
33862026-03-03T16:56:45.912ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u8\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
33872026-03-03T16:56:45.928ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i16\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int16)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
33882026-03-03T16:56:45.945ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u16\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt16)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
33892026-03-03T16:56:45.957ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
33902026-03-03T16:56:45.973ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
33912026-03-03T16:56:45.986ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
33922026-03-03T16:56:46.002ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 167f54a0-df78-49db-aee7-111ed892ca3f
33932026-03-03T16:56:46.003ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 167f54a0-df78-49db-aee7-111ed892ca3f time_started = 2026-03-03 16:56:45.351135 UTC
33942026-03-03T16:56:46.003ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 774.887212ms iteration = 3 status = {"collection_id":"167f54a0-df78-49db-aee7-111ed892ca3f","time_done":"2026-03-03 16:56:45.683844 UTC","time_started":"2026-03-03 16:56:45.351135 UTC"}
33952026-03-03T16:56:46.003ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 2 reason = Dependency
33962026-03-03T16:56:46.003ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
33972026-03-03T16:56:46.003ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
33982026-03-03T16:56:46.003ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
33992026-03-03T16:56:46.003ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
34002026-03-03T16:56:46.003ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
34012026-03-03T16:56:46.005ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34022026-03-03T16:56:46.009ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
34032026-03-03T16:56:46.009ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
34042026-03-03T16:56:46.009ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
34052026-03-03T16:56:46.009ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
34062026-03-03T16:56:46.010ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34072026-03-03T16:56:46.011ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
34082026-03-03T16:56:46.011ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
34092026-03-03T16:56:46.012ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
34102026-03-03T16:56:46.023ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_f32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34112026-03-03T16:56:46.038ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_f64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34122026-03-03T16:56:46.058ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_string\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(String)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34132026-03-03T16:56:46.071ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_bytes\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n /*\n * NOTE: Right now we can't unambiguously record a nullable byte array.\n * Arrays cannot be nested in `Nullable()` types, and encoding the array as\n * a string isn't palatable for a few reasons.\n * See: https://github.com/oxidecomputer/omicron/issues/4551 for more\n * details.\n */\n datum Array(UInt8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34142026-03-03T16:56:46.081ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34152026-03-03T16:56:46.094ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34162026-03-03T16:56:46.103ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34172026-03-03T16:56:46.114ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 107.07774ms iteration = 2 status = {"Loaded":{"collection_id":"167f54a0-df78-49db-aee7-111ed892ca3f","time_loaded":"2026-03-03T16:56:46.002879710Z","time_started":"2026-03-03T16:56:45.351135Z"}}
34182026-03-03T16:56:46.114ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
34192026-03-03T16:56:46.114ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 15.71\u{b5}s iteration = 2 status = {"error":"task disabled"}
34202026-03-03T16:56:46.114ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 2 reason = Dependency
34212026-03-03T16:56:46.114ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
34222026-03-03T16:56:46.114ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
34232026-03-03T16:56:46.114ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
34242026-03-03T16:56:46.114ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34252026-03-03T16:56:46.114ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34262026-03-03T16:56:46.114ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 2 reason = Dependency
34272026-03-03T16:56:46.114ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
34282026-03-03T16:56:46.114ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
34292026-03-03T16:56:46.114ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
34302026-03-03T16:56:46.114ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 4 reason = Dependency
34312026-03-03T16:56:46.114ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
34322026-03-03T16:56:46.114ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 21.14\u{b5}s iteration = 4 status = "Disabled"
34332026-03-03T16:56:46.114ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 92 ba 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:54401 req_id = f8afc048-8203-4c94-bdfb-60f426f86311
34342026-03-03T16:56:46.114ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 37562,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:54401 req_id = f8afc048-8203-4c94-bdfb-60f426f86311
34352026-03-03T16:56:46.114ZDEBGtest_metrics (store): query key key = _dendrite._tcp
34362026-03-03T16:56:46.114ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
34372026-03-03T16:56:46.114ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:54401 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = f8afc048-8203-4c94-bdfb-60f426f86311
34382026-03-03T16:56:46.114ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1868, tv_nsec: 369862363 } })
34392026-03-03T16:56:46.114ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
34402026-03-03T16:56:46.114ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 35 82 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e 5...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:20537 req_id = cc922e05-c2b7-4a40-bd9f-5b21d138a84f
34412026-03-03T16:56:46.114ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 13698,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:20537 req_id = cc922e05-c2b7-4a40-bd9f-5b21d138a84f
34422026-03-03T16:56:46.114ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
34432026-03-03T16:56:46.114ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:20537 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = cc922e05-c2b7-4a40-bd9f-5b21d138a84f
34442026-03-03T16:56:46.132ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:42205/switch/identifiers
34452026-03-03T16:56:46.134ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34462026-03-03T16:56:46.135ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34472026-03-03T16:56:46.138ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
34482026-03-03T16:56:46.138ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
34492026-03-03T16:56:46.138ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
34502026-03-03T16:56:46.139ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
34512026-03-03T16:56:46.139ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34522026-03-03T16:56:46.139ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34532026-03-03T16:56:46.141ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:42205/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0cb55fa-8364-44a8-9d64-d6c9aea99a7c", "content-length": "206", "date": "Tue, 03 Mar 2026 16:56:46 GMT"} })
34542026-03-03T16:56:46.141ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
34552026-03-03T16:56:46.141ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
34562026-03-03T16:56:46.141ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
34572026-03-03T16:56:46.142ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
34582026-03-03T16:56:46.142ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n /*\n * NOTE: Array types cannot be Nullable, see\n * https://clickhouse.com/docs/en/sql-reference/data-types/nullable\n * for more details.\n *\n * This means we need to use empty arrays to indicate a missing value. This\n * is unfortunate, and at this point relies on the fact that an\n * `oximeter::Histogram` cannot have zero bins. If that changes, we'll need\n * to figure out another way to represent missing samples here.\n */\n bins Array(Int8),\n counts Array(UInt64),\n min Int8,\n max Int8,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34592026-03-03T16:56:46.143ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34602026-03-03T16:56:46.146ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
34612026-03-03T16:56:46.148ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
34622026-03-03T16:56:46.148ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34632026-03-03T16:56:46.148ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34642026-03-03T16:56:46.154ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
34652026-03-03T16:56:46.161ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
34662026-03-03T16:56:46.161ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
34672026-03-03T16:56:46.161ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34682026-03-03T16:56:46.161ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34692026-03-03T16:56:46.172ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt8),\n counts Array(UInt64),\n min UInt8,\n max UInt8,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34702026-03-03T16:56:46.172ZDEBGtest_metrics (producer-registration-task): will register with Nexus at 127.0.0.1:46333
34712026-03-03T16:56:46.184ZDEBGtest_metrics (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:46333/metrics/producers
34722026-03-03T16:56:46.185ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
34732026-03-03T16:56:46.185ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
34742026-03-03T16:56:46.185ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
34752026-03-03T16:56:46.185ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
34762026-03-03T16:56:46.185ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
34772026-03-03T16:56:46.193ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34782026-03-03T16:56:46.196ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
34792026-03-03T16:56:46.196ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
34802026-03-03T16:56:46.196ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
34812026-03-03T16:56:46.196ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
34822026-03-03T16:56:46.196ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34832026-03-03T16:56:46.196ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34842026-03-03T16:56:46.197ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int16),\n counts Array(UInt64),\n min Int16,\n max Int16,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34852026-03-03T16:56:46.198ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:46333 remote_addr = 127.0.0.1:45748
34862026-03-03T16:56:46.200ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45748 req_id = 30b99a07-6211-4a1f-93bf-aff223a0adbd uri = /metrics/producers
34872026-03-03T16:56:46.200ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45748 req_id = 30b99a07-6211-4a1f-93bf-aff223a0adbd uri = /metrics/producers version = 1.0.0
34882026-03-03T16:56:46.201ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45748 req_id = 30b99a07-6211-4a1f-93bf-aff223a0adbd resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
34892026-03-03T16:56:46.201ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45748 req_id = 30b99a07-6211-4a1f-93bf-aff223a0adbd roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
34902026-03-03T16:56:46.201ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45748 req_id = 30b99a07-6211-4a1f-93bf-aff223a0adbd resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
34912026-03-03T16:56:46.205ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34922026-03-03T16:56:46.209ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
34932026-03-03T16:56:46.209ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
34942026-03-03T16:56:46.209ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34952026-03-03T16:56:46.209ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34962026-03-03T16:56:46.211ZINFOtest_metrics (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment latency_us = 12181 local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45748 req_id = 30b99a07-6211-4a1f-93bf-aff223a0adbd response_code = 503 uri = /metrics/producers
34972026-03-03T16:56:46.212ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt16),\n counts Array(UInt64),\n min UInt16,\n max UInt16,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
34982026-03-03T16:56:46.214ZDEBGtest_metrics (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "30b99a07-6211-4a1f-93bf-aff223a0adbd", "content-length": "133", "date": "Tue, 03 Mar 2026 16:56:46 GMT"} })
34992026-03-03T16:56:46.215ZWARNtest_metrics (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 406.511356ms error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "30b99a07-6211-4a1f-93bf-aff223a0adbd", "content-length": "133", "date": "Tue, 03 Mar 2026 16:56:46 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "30b99a07-6211-4a1f-93bf-aff223a0adbd" } file = oximeter/producer/src/lib.rs:377
35002026-03-03T16:56:46.215ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
35012026-03-03T16:56:46.215ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
35022026-03-03T16:56:46.215ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
35032026-03-03T16:56:46.215ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
35042026-03-03T16:56:46.215ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35052026-03-03T16:56:46.216ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35062026-03-03T16:56:46.217ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35072026-03-03T16:56:46.221ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35082026-03-03T16:56:46.221ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
35092026-03-03T16:56:46.221ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
35102026-03-03T16:56:46.221ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
35112026-03-03T16:56:46.221ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35122026-03-03T16:56:46.222ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35132026-03-03T16:56:46.222ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int32),\n counts Array(UInt64),\n min Int32,\n max Int32,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
35142026-03-03T16:56:46.223ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35152026-03-03T16:56:46.226ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35162026-03-03T16:56:46.227ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
35172026-03-03T16:56:46.227ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35182026-03-03T16:56:46.227ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35192026-03-03T16:56:46.230ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
35202026-03-03T16:56:46.230ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
35212026-03-03T16:56:46.230ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
35222026-03-03T16:56:46.230ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
35232026-03-03T16:56:46.230ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35242026-03-03T16:56:46.230ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35252026-03-03T16:56:46.233ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt32),\n counts Array(UInt64),\n min UInt32,\n max UInt32,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
35262026-03-03T16:56:46.238ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35272026-03-03T16:56:46.241ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35282026-03-03T16:56:46.241ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
35292026-03-03T16:56:46.241ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
35302026-03-03T16:56:46.241ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
35312026-03-03T16:56:46.241ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35322026-03-03T16:56:46.242ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35332026-03-03T16:56:46.245ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
35342026-03-03T16:56:46.245ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
35352026-03-03T16:56:46.245ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
35362026-03-03T16:56:46.245ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
35372026-03-03T16:56:46.245ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
35382026-03-03T16:56:46.246ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int64),\n counts Array(UInt64),\n min Int64,\n max Int64,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
35392026-03-03T16:56:46.247ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35402026-03-03T16:56:46.253ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35412026-03-03T16:56:46.260ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
35422026-03-03T16:56:46.260ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35432026-03-03T16:56:46.260ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35442026-03-03T16:56:46.263ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
35452026-03-03T16:56:46.264ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 153.914075ms iteration = 2 status = {"blueprint_id":"17e53f87-23ca-4758-8dd3-9566e405f268","inventory_collection_id":"167f54a0-df78-49db-aee7-111ed892ca3f","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
35462026-03-03T16:56:46.266ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt64),\n counts Array(UInt64),\n min UInt64,\n max UInt64,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
35472026-03-03T16:56:46.284ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Float32),\n counts Array(UInt64),\n min Float32,\n max Float32,\n sum_of_samples Float64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
35482026-03-03T16:56:46.299ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Float64),\n counts Array(UInt64),\n min Float64,\n max Float64,\n sum_of_samples Float64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
35492026-03-03T16:56:46.304ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
35502026-03-03T16:56:46.304ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
35512026-03-03T16:56:46.304ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
35522026-03-03T16:56:46.304ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
35532026-03-03T16:56:46.304ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
35542026-03-03T16:56:46.319ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\n/* The field tables store named dimensions of each timeseries.\n *\n * As with the measurement tables, there is one field table for each field data\n * type. Fields are deduplicated by using the "replacing merge tree", though\n * this behavior **must not** be relied upon for query correctness.\n *\n * The index for the fields differs from the measurements, however. Rows are\n * sorted by timeseries name, then field name, field value, and finally\n * timeseries key. This reflects the most common pattern for looking them up:\n * by field name and possibly value, within a timeseries. The resulting keys are\n * usually then used to look up measurements.\n *\n * NOTE: We may want to consider a secondary index on these tables, sorting by\n * timeseries name and then key, since it would improve lookups where one\n * already has the key. Realistically though, these tables are quite small and\n * so performance benefits will be low in absolute terms.\n *\n * TTL: We use a materialized column to expire old field table records. This\n * column is generated automatically by the database whenever a new row is\n * inserted. It cannot be inserted directly, nor is it returned in a `SELECT *`\n * query. Since these tables are `ReplacingMergeTree`s, that means the last\n * record will remain during a deduplication, which will have the last\n * timestamp. ClickHouse will then expire old data for us, similar to the\n * measurement tables.\n */\nCREATE TABLE IF NOT EXISTS oximeter.fields_bool\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Bool,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35552026-03-03T16:56:46.334ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i8\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int8,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35562026-03-03T16:56:46.342ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
35572026-03-03T16:56:46.342ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
35582026-03-03T16:56:46.342ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
35592026-03-03T16:56:46.342ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
35602026-03-03T16:56:46.344ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
35612026-03-03T16:56:46.345ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
35622026-03-03T16:56:46.345ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
35632026-03-03T16:56:46.345ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
35642026-03-03T16:56:46.345ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
35652026-03-03T16:56:46.346ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u8\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt8,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35662026-03-03T16:56:46.347ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
35672026-03-03T16:56:46.348ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
35682026-03-03T16:56:46.348ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
35692026-03-03T16:56:46.348ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 236.881986ms iteration = 2 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
35702026-03-03T16:56:46.358ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i16\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int16,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35712026-03-03T16:56:46.374ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u16\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt16,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35722026-03-03T16:56:46.387ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i32\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int32,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35732026-03-03T16:56:46.395ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u32\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt32,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35742026-03-03T16:56:46.407ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i64\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int64,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35752026-03-03T16:56:46.423ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u64\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt64,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35762026-03-03T16:56:46.438ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value IPv6,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35772026-03-03T16:56:46.450ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_string\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value String,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35782026-03-03T16:56:46.471ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_uuid\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UUID,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
35792026-03-03T16:56:46.487ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = \n\n/* The timeseries schema table stores the extracted schema for the samples\n * oximeter collects.\n */\nCREATE TABLE IF NOT EXISTS oximeter.timeseries_schema\n(\n timeseries_name String,\n fields Nested(\n name String,\n type Enum(\n 'Bool' = 1,\n 'I64' = 2,\n 'IpAddr' = 3,\n 'String' = 4,\n 'Uuid' = 6,\n 'I8' = 7,\n 'U8' = 8,\n 'I16' = 9,\n 'U16' = 10,\n 'I32' = 11,\n 'U32' = 12,\n 'U64' = 13\n ),\n source Enum(\n 'Target' = 1,\n 'Metric' = 2\n )\n ),\n datum_type Enum(\n 'Bool' = 1,\n 'I64' = 2,\n 'F64' = 3,\n 'String' = 4,\n 'Bytes' = 5,\n 'CumulativeI64' = 6,\n 'CumulativeF64' = 7,\n 'HistogramI64' = 8,\n 'HistogramF64' = 9,\n 'I8' = 10,\n 'U8' = 11,\n 'I16' = 12,\n 'U16' = 13,\n 'I32' = 14,\n 'U32' = 15,\n 'U64' = 16,\n 'F32' = 17,\n 'CumulativeU64' = 18,\n 'CumulativeF32' = 19,\n 'HistogramI8' = 20,\n 'HistogramU8' = 21,\n 'HistogramI16' = 22,\n 'HistogramU16' = 23,\n 'HistogramI32' = 24,\n 'HistogramU32' = 25,\n 'HistogramU64' = 26,\n 'HistogramF32' = 27\n ),\n created DateTime64(9, 'UTC')\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, fields.name)
35802026-03-03T16:56:46.500ZINFOtest_metrics (clickhouse-client): inserting current version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:831 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 version = 14
35812026-03-03T16:56:46.500ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = INSERT INTO oximeter.version (*) VALUES (14, now());
35822026-03-03T16:56:46.502ZDEBGtest_metrics (clickhouse-client): registered USDT probes collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = d69e43b5-e7f4-4201-8db8-6be586cb79e8
35832026-03-03T16:56:46.504ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:46085 method = GET path = /info versions = all
35842026-03-03T16:56:46.504ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:46085 method = GET path = /producers versions = all
35852026-03-03T16:56:46.504ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:46085 method = DELETE path = /producers/{producer_id} versions = all
35862026-03-03T16:56:46.504ZDEBGtest_metrics (dropshot): registered endpoint local_addr = [::1]:46085 method = GET path = /producers/{producer_id} versions = all
35872026-03-03T16:56:46.504ZINFOtest_metrics (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [::1]:46085
35882026-03-03T16:56:46.504ZDEBGtest_metrics (dropshot): successfully registered DTrace USDT probes local_addr = [::1]:46085
35892026-03-03T16:56:46.504ZDEBGtest_metrics (oximeter): registered USDT probes
35902026-03-03T16:56:46.504ZDEBGtest_metrics (oximeter): contacting nexus
35912026-03-03T16:56:46.570ZDEBGtest_metrics (oximeter): client request body = Some(Body) method = POST uri = http://127.0.0.1:46333/metrics/collectors
35922026-03-03T16:56:46.570ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:46333 remote_addr = 127.0.0.1:45750
35932026-03-03T16:56:46.570ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45750 req_id = 0e233e77-a516-4ecf-9ea1-50aaef957df2 uri = /metrics/collectors
35942026-03-03T16:56:46.571ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45750 req_id = 0e233e77-a516-4ecf-9ea1-50aaef957df2 uri = /metrics/collectors version = 1.0.0
35952026-03-03T16:56:46.571ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45750 req_id = 0e233e77-a516-4ecf-9ea1-50aaef957df2 resource = Database type = user_builtin uri = /metrics/collectors user_builtin_id = 001de000-05e4-4000-8000-000000000002
35962026-03-03T16:56:46.571ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45750 req_id = 0e233e77-a516-4ecf-9ea1-50aaef957df2 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors user_builtin_id = 001de000-05e4-4000-8000-000000000002
35972026-03-03T16:56:46.571ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45750 req_id = 0e233e77-a516-4ecf-9ea1-50aaef957df2 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors user_builtin_id = 001de000-05e4-4000-8000-000000000002
35982026-03-03T16:56:46.574ZINFOtest_metrics (nexus): registered new oximeter metric collection server address = [::1]:46085 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78
35992026-03-03T16:56:46.574ZINFOtest_metrics (dropshot_internal): request completed latency_us = 3622 local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45750 req_id = 0e233e77-a516-4ecf-9ea1-50aaef957df2 response_code = 204 uri = /metrics/collectors
36002026-03-03T16:56:46.574ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/collectors", status: 204, headers: {"x-request-id": "0e233e77-a516-4ecf-9ea1-50aaef957df2", "date": "Tue, 03 Mar 2026 16:56:46 GMT"} })
36012026-03-03T16:56:46.574ZINFOtest_metrics (oximeter): oximeter registered with nexus file = oximeter/collector/src/lib.rs:427 id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78
36022026-03-03T16:56:46.574ZDEBGtest_metrics (init_with_steps): Running step start_producer_server
36032026-03-03T16:56:46.574ZDEBGtest_metrics: Starting test metric Producer Server
36042026-03-03T16:56:46.575ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:40151/v1/system/ip-pools
36052026-03-03T16:56:46.575ZINFOtest_metrics (oximeter-agent): starting refresh list task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:554
36062026-03-03T16:56:46.584ZINFOtest_metrics (dropshot_external): accepted connection local_addr = 127.0.0.1:40151 remote_addr = 127.0.0.1:36496
36072026-03-03T16:56:46.585ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:46333 remote_addr = 127.0.0.1:45752
36082026-03-03T16:56:46.585ZINFOtest_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
36092026-03-03T16:56:46.585ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
36102026-03-03T16:56:46.585ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45752 req_id = f2ff08fa-4691-4591-a1c1-a2b81f79f6f6 uri = /metrics/producers
36112026-03-03T16:56:46.585ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45752 req_id = f2ff08fa-4691-4591-a1c1-a2b81f79f6f6 uri = /metrics/producers version = 1.0.0
36122026-03-03T16:56:46.585ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 720786b6-b9f5-41b6-a822-62161d2d25da uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
36132026-03-03T16:56:46.585ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 720786b6-b9f5-41b6-a822-62161d2d25da uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
36142026-03-03T16:56:46.585ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45752 req_id = f2ff08fa-4691-4591-a1c1-a2b81f79f6f6 resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
36152026-03-03T16:56:46.585ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45752 req_id = f2ff08fa-4691-4591-a1c1-a2b81f79f6f6 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
36162026-03-03T16:56:46.586ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45752 req_id = f2ff08fa-4691-4591-a1c1-a2b81f79f6f6 resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
36172026-03-03T16:56:46.586ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 720786b6-b9f5-41b6-a822-62161d2d25da resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
36182026-03-03T16:56:46.587ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 720786b6-b9f5-41b6-a822-62161d2d25da roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
36192026-03-03T16:56:46.587ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 720786b6-b9f5-41b6-a822-62161d2d25da resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
36202026-03-03T16:56:46.587ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d uri = /v1/system/ip-pools
36212026-03-03T16:56:46.587ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d uri = /v1/system/ip-pools version = 2026021900.0.0
36222026-03-03T16:56:46.587ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d uri = /v1/system/ip-pools
36232026-03-03T16:56:46.587ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools
36242026-03-03T16:56:46.587ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
36252026-03-03T16:56:46.587ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
36262026-03-03T16:56:46.588ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
36272026-03-03T16:56:46.590ZINFOtest_metrics (dropshot_internal): request completed latency_us = 4602 local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 720786b6-b9f5-41b6-a822-62161d2d25da response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
36282026-03-03T16:56:46.590ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
36292026-03-03T16:56:46.590ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
36302026-03-03T16:56:46.590ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
36312026-03-03T16:56:46.592ZINFOtest_metrics (nexus): assigned collector to new producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
36322026-03-03T16:56:46.592ZINFOtest_metrics (dropshot_internal): request completed latency_us = 5810 local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45752 req_id = f2ff08fa-4691-4591-a1c1-a2b81f79f6f6 response_code = 201 uri = /metrics/producers
36332026-03-03T16:56:46.592ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "720786b6-b9f5-41b6-a822-62161d2d25da", "content-length": "29", "date": "Tue, 03 Mar 2026 16:56:46 GMT"} })
36342026-03-03T16:56:46.592ZINFOtest_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
36352026-03-03T16:56:46.592ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
36362026-03-03T16:56:46.592ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
36372026-03-03T16:56:46.592ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
36382026-03-03T16:56:46.592ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
36392026-03-03T16:56:46.592ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
36402026-03-03T16:56:46.593ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
36412026-03-03T16:56:46.593ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
36422026-03-03T16:56:46.593ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
36432026-03-03T16:56:46.594ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
36442026-03-03T16:56:46.595ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36452026-03-03T16:56:46.597ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
36462026-03-03T16:56:46.599ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
36472026-03-03T16:56:46.599ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
36482026-03-03T16:56:46.599ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
36492026-03-03T16:56:46.599ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
36502026-03-03T16:56:46.599ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
36512026-03-03T16:56:46.599ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
36522026-03-03T16:56:46.599ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
36532026-03-03T16:56:46.599ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
36542026-03-03T16:56:46.600ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
36552026-03-03T16:56:46.601ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
36562026-03-03T16:56:46.601ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
36572026-03-03T16:56:46.601ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
36582026-03-03T16:56:46.601ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36592026-03-03T16:56:46.603ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
36602026-03-03T16:56:46.604ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d uri = /v1/system/ip-pools
36612026-03-03T16:56:46.604ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36622026-03-03T16:56:46.604ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36632026-03-03T16:56:46.605ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36642026-03-03T16:56:46.605ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36652026-03-03T16:56:46.605ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36662026-03-03T16:56:46.610ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36672026-03-03T16:56:46.612ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36682026-03-03T16:56:46.612ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36692026-03-03T16:56:46.612ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36702026-03-03T16:56:46.612ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36712026-03-03T16:56:46.670ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36722026-03-03T16:56:46.670ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36732026-03-03T16:56:46.670ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36742026-03-03T16:56:46.670ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36752026-03-03T16:56:46.671ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36762026-03-03T16:56:46.673ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36772026-03-03T16:56:46.676ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36782026-03-03T16:56:46.676ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36792026-03-03T16:56:46.676ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36802026-03-03T16:56:46.676ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36812026-03-03T16:56:46.678ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36822026-03-03T16:56:46.678ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36832026-03-03T16:56:46.679ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36842026-03-03T16:56:46.679ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36852026-03-03T16:56:46.679ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36862026-03-03T16:56:46.680ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36872026-03-03T16:56:46.681ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36882026-03-03T16:56:46.682ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36892026-03-03T16:56:46.682ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36902026-03-03T16:56:46.682ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
36912026-03-03T16:56:46.711ZDEBGtest_metrics (producer-registration-task): will register with Nexus at 127.0.0.1:46333
36922026-03-03T16:56:46.722ZDEBGtest_metrics (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:46333/metrics/producers
36932026-03-03T16:56:46.723ZINFOtest_metrics (dropshot_external): request completed latency_us = 135744 local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 98bf53ee-5247-4bf3-8fa2-6d63762c695d response_code = 201 uri = /v1/system/ip-pools
36942026-03-03T16:56:46.723ZINFOtest_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:46333 remote_addr = 127.0.0.1:45754
36952026-03-03T16:56:46.724ZINFOtest_metrics (external client test context): client received response status = 201
36962026-03-03T16:56:46.725ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:40151/v1/system/ip-pools/default-v4/ranges/add
36972026-03-03T16:56:46.725ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45754 req_id = 0b9e5e53-2701-4730-9e41-3aef0e45c29d uri = /metrics/producers
36982026-03-03T16:56:46.725ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45754 req_id = 0b9e5e53-2701-4730-9e41-3aef0e45c29d uri = /metrics/producers version = 1.0.0
36992026-03-03T16:56:46.725ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45754 req_id = 0b9e5e53-2701-4730-9e41-3aef0e45c29d resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
37002026-03-03T16:56:46.725ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45754 req_id = 0b9e5e53-2701-4730-9e41-3aef0e45c29d roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
37012026-03-03T16:56:46.725ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45754 req_id = 0b9e5e53-2701-4730-9e41-3aef0e45c29d resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
37022026-03-03T16:56:46.726ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df uri = /v1/system/ip-pools/default-v4/ranges/add
37032026-03-03T16:56:46.726ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df uri = /v1/system/ip-pools/default-v4/ranges/add version = 2026021900.0.0
37042026-03-03T16:56:46.726ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df uri = /v1/system/ip-pools/default-v4/ranges/add
37052026-03-03T16:56:46.726ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v4/ranges/add
37062026-03-03T16:56:46.726ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
37072026-03-03T16:56:46.726ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
37082026-03-03T16:56:46.726ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
37092026-03-03T16:56:46.730ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
37102026-03-03T16:56:46.730ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
37112026-03-03T16:56:46.731ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
37122026-03-03T16:56:46.732ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
37132026-03-03T16:56:46.733ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
37142026-03-03T16:56:46.733ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
37152026-03-03T16:56:46.733ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
37162026-03-03T16:56:46.733ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
37172026-03-03T16:56:46.734ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37182026-03-03T16:56:46.734ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
37192026-03-03T16:56:46.734ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
37202026-03-03T16:56:46.735ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
37212026-03-03T16:56:46.737ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37222026-03-03T16:56:46.740ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
37232026-03-03T16:56:46.740ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
37242026-03-03T16:56:46.740ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
37252026-03-03T16:56:46.740ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
37262026-03-03T16:56:46.742ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
37272026-03-03T16:56:46.742ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
37282026-03-03T16:56:46.742ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
37292026-03-03T16:56:46.742ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
37302026-03-03T16:56:46.742ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
37312026-03-03T16:56:46.743ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37322026-03-03T16:56:46.744ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
37332026-03-03T16:56:46.744ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
37342026-03-03T16:56:46.744ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
37352026-03-03T16:56:46.746ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37362026-03-03T16:56:46.748ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
37372026-03-03T16:56:46.748ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df uri = /v1/system/ip-pools/default-v4/ranges/add
37382026-03-03T16:56:46.748ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37392026-03-03T16:56:46.748ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37402026-03-03T16:56:46.748ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37412026-03-03T16:56:46.748ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37422026-03-03T16:56:46.749ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37432026-03-03T16:56:46.751ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37442026-03-03T16:56:46.752ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37452026-03-03T16:56:46.752ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37462026-03-03T16:56:46.752ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37472026-03-03T16:56:46.753ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37482026-03-03T16:56:46.754ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37492026-03-03T16:56:46.755ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37502026-03-03T16:56:46.755ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37512026-03-03T16:56:46.755ZINFOtest_metrics (nexus): assigned collector to new producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 producer_id = 913233fe-92a8-4635-9572-183f495429c4
37522026-03-03T16:56:46.756ZINFOtest_metrics (dropshot_internal): request completed latency_us = 31625 local_addr = 127.0.0.1:46333 method = POST remote_addr = 127.0.0.1:45754 req_id = 0b9e5e53-2701-4730-9e41-3aef0e45c29d response_code = 201 uri = /metrics/producers
37532026-03-03T16:56:46.756ZDEBGtest_metrics (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0b9e5e53-2701-4730-9e41-3aef0e45c29d", "content-length": "41", "date": "Tue, 03 Mar 2026 16:56:46 GMT"} })
37542026-03-03T16:56:46.756ZDEBGtest_metrics (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
37552026-03-03T16:56:46.757ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = IpPool { parent: Fleet, key: 9c93b8b6-74b3-476e-b4ba-9d17dd375032, lookup_type: ByName("default-v4") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37562026-03-03T16:56:46.757ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37572026-03-03T16:56:46.757ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37582026-03-03T16:56:46.757ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37592026-03-03T16:56:46.757ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37602026-03-03T16:56:46.759ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37612026-03-03T16:56:46.762ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = IpPool { parent: Fleet, key: 9c93b8b6-74b3-476e-b4ba-9d17dd375032, lookup_type: ByName("default-v4") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37622026-03-03T16:56:46.762ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37632026-03-03T16:56:46.762ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37642026-03-03T16:56:46.762ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37652026-03-03T16:56:46.790ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37662026-03-03T16:56:46.790ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37672026-03-03T16:56:46.791ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37682026-03-03T16:56:46.792ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = IpPool { parent: Fleet, key: 9c93b8b6-74b3-476e-b4ba-9d17dd375032, lookup_type: ByName("default-v4") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37692026-03-03T16:56:46.792ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37702026-03-03T16:56:46.792ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37712026-03-03T16:56:46.792ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37722026-03-03T16:56:46.792ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37732026-03-03T16:56:46.794ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37742026-03-03T16:56:46.796ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = IpPool { parent: Fleet, key: 9c93b8b6-74b3-476e-b4ba-9d17dd375032, lookup_type: ByName("default-v4") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37752026-03-03T16:56:46.800ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37762026-03-03T16:56:46.800ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37772026-03-03T16:56:46.800ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37782026-03-03T16:56:46.800ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37792026-03-03T16:56:46.801ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37802026-03-03T16:56:46.803ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37812026-03-03T16:56:46.804ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37822026-03-03T16:56:46.805ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37832026-03-03T16:56:46.805ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37842026-03-03T16:56:46.805ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
37852026-03-03T16:56:46.807ZINFOtest_metrics (dropshot_external): request completed latency_us = 81043 local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = a7d1ba51-dcf2-49a2-adb9-b2892416d0df response_code = 201 uri = /v1/system/ip-pools/default-v4/ranges/add
37862026-03-03T16:56:46.808ZINFOtest_metrics (external client test context): client received response status = 201
37872026-03-03T16:56:46.808ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:40151/v1/system/ip-pools/default-v4/silos
37882026-03-03T16:56:46.808ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 uri = /v1/system/ip-pools/default-v4/silos
37892026-03-03T16:56:46.808ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 uri = /v1/system/ip-pools/default-v4/silos version = 2026021900.0.0
37902026-03-03T16:56:46.808ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 uri = /v1/system/ip-pools/default-v4/silos
37912026-03-03T16:56:46.808ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v4/silos
37922026-03-03T16:56:46.808ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
37932026-03-03T16:56:46.808ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
37942026-03-03T16:56:46.808ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
37952026-03-03T16:56:46.809ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
37962026-03-03T16:56:46.810ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
37972026-03-03T16:56:46.810ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
37982026-03-03T16:56:46.811ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
37992026-03-03T16:56:46.811ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
38002026-03-03T16:56:46.811ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
38012026-03-03T16:56:46.811ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
38022026-03-03T16:56:46.811ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
38032026-03-03T16:56:46.812ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38042026-03-03T16:56:46.812ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
38052026-03-03T16:56:46.812ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
38062026-03-03T16:56:46.813ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
38072026-03-03T16:56:46.814ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38082026-03-03T16:56:46.816ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
38092026-03-03T16:56:46.818ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
38102026-03-03T16:56:46.818ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
38112026-03-03T16:56:46.818ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
38122026-03-03T16:56:46.818ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
38132026-03-03T16:56:46.818ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
38142026-03-03T16:56:46.818ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
38152026-03-03T16:56:46.818ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
38162026-03-03T16:56:46.818ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
38172026-03-03T16:56:46.819ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38182026-03-03T16:56:46.819ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
38192026-03-03T16:56:46.819ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
38202026-03-03T16:56:46.819ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
38212026-03-03T16:56:46.820ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38222026-03-03T16:56:46.822ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
38232026-03-03T16:56:46.822ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 uri = /v1/system/ip-pools/default-v4/silos
38242026-03-03T16:56:46.822ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38252026-03-03T16:56:46.822ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38262026-03-03T16:56:46.823ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38272026-03-03T16:56:46.823ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38282026-03-03T16:56:46.823ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38292026-03-03T16:56:46.824ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38302026-03-03T16:56:46.826ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38312026-03-03T16:56:46.827ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38322026-03-03T16:56:46.827ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38332026-03-03T16:56:46.827ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38342026-03-03T16:56:46.828ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38352026-03-03T16:56:46.828ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38362026-03-03T16:56:46.828ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38372026-03-03T16:56:46.829ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = IpPool { parent: Fleet, key: 9c93b8b6-74b3-476e-b4ba-9d17dd375032, lookup_type: ByName("default-v4") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38382026-03-03T16:56:46.829ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38392026-03-03T16:56:46.829ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38402026-03-03T16:56:46.829ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38412026-03-03T16:56:46.830ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38422026-03-03T16:56:46.832ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38432026-03-03T16:56:46.835ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = IpPool { parent: Fleet, key: 9c93b8b6-74b3-476e-b4ba-9d17dd375032, lookup_type: ByName("default-v4") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38442026-03-03T16:56:46.836ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38452026-03-03T16:56:46.836ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38462026-03-03T16:56:46.836ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38472026-03-03T16:56:46.836ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38482026-03-03T16:56:46.836ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38492026-03-03T16:56:46.837ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38502026-03-03T16:56:46.838ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38512026-03-03T16:56:46.838ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38522026-03-03T16:56:46.838ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38532026-03-03T16:56:46.838ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38542026-03-03T16:56:46.838ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38552026-03-03T16:56:46.840ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38562026-03-03T16:56:46.840ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38572026-03-03T16:56:46.840ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38582026-03-03T16:56:46.840ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38592026-03-03T16:56:46.842ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38602026-03-03T16:56:46.843ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38612026-03-03T16:56:46.845ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38622026-03-03T16:56:46.845ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38632026-03-03T16:56:46.845ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38642026-03-03T16:56:46.845ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38652026-03-03T16:56:46.845ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38662026-03-03T16:56:46.845ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38672026-03-03T16:56:46.848ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38682026-03-03T16:56:46.848ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38692026-03-03T16:56:46.848ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38702026-03-03T16:56:46.849ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38712026-03-03T16:56:46.880ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38722026-03-03T16:56:46.882ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38732026-03-03T16:56:46.882ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38742026-03-03T16:56:46.882ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38752026-03-03T16:56:46.882ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38762026-03-03T16:56:46.883ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38772026-03-03T16:56:46.884ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38782026-03-03T16:56:46.886ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38792026-03-03T16:56:46.886ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38802026-03-03T16:56:46.886ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
38812026-03-03T16:56:46.887ZINFOtest_metrics (dropshot_external): request completed latency_us = 79639 local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = b26cef02-f7da-4de9-935a-8ce0f891aa22 response_code = 201 uri = /v1/system/ip-pools/default-v4/silos
38822026-03-03T16:56:46.887ZINFOtest_metrics (external client test context): client received response status = 201
38832026-03-03T16:56:46.888ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:40151/v1/system/ip-pools
38842026-03-03T16:56:46.888ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a uri = /v1/system/ip-pools
38852026-03-03T16:56:46.888ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a uri = /v1/system/ip-pools version = 2026021900.0.0
38862026-03-03T16:56:46.888ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a uri = /v1/system/ip-pools
38872026-03-03T16:56:46.888ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools
38882026-03-03T16:56:46.888ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
38892026-03-03T16:56:46.888ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
38902026-03-03T16:56:46.888ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
38912026-03-03T16:56:46.890ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
38922026-03-03T16:56:46.890ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
38932026-03-03T16:56:46.890ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
38942026-03-03T16:56:46.892ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
38952026-03-03T16:56:46.892ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
38962026-03-03T16:56:46.892ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
38972026-03-03T16:56:46.892ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
38982026-03-03T16:56:46.892ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
38992026-03-03T16:56:46.893ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
39002026-03-03T16:56:46.893ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39012026-03-03T16:56:46.893ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39022026-03-03T16:56:46.894ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39032026-03-03T16:56:46.895ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39042026-03-03T16:56:46.897ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
39052026-03-03T16:56:46.897ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39062026-03-03T16:56:46.897ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39072026-03-03T16:56:46.897ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39082026-03-03T16:56:46.899ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
39092026-03-03T16:56:46.899ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
39102026-03-03T16:56:46.899ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39112026-03-03T16:56:46.899ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39122026-03-03T16:56:46.899ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39132026-03-03T16:56:46.900ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
39142026-03-03T16:56:46.900ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39152026-03-03T16:56:46.900ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39162026-03-03T16:56:46.900ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39172026-03-03T16:56:46.901ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39182026-03-03T16:56:46.903ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
39192026-03-03T16:56:46.903ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a uri = /v1/system/ip-pools
39202026-03-03T16:56:46.903ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39212026-03-03T16:56:46.903ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39222026-03-03T16:56:46.903ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39232026-03-03T16:56:46.903ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39242026-03-03T16:56:46.904ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39252026-03-03T16:56:46.905ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39262026-03-03T16:56:46.907ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39272026-03-03T16:56:46.907ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39282026-03-03T16:56:46.907ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39292026-03-03T16:56:46.907ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39302026-03-03T16:56:46.909ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39312026-03-03T16:56:46.909ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39322026-03-03T16:56:46.909ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39332026-03-03T16:56:46.909ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39342026-03-03T16:56:46.909ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39352026-03-03T16:56:46.911ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39362026-03-03T16:56:46.914ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39372026-03-03T16:56:46.914ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39382026-03-03T16:56:46.914ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39392026-03-03T16:56:46.914ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39402026-03-03T16:56:46.916ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39412026-03-03T16:56:46.916ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39422026-03-03T16:56:46.916ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39432026-03-03T16:56:46.916ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39442026-03-03T16:56:46.916ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39452026-03-03T16:56:46.918ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39462026-03-03T16:56:46.919ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39472026-03-03T16:56:46.919ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39482026-03-03T16:56:46.919ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39492026-03-03T16:56:46.919ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39502026-03-03T16:56:46.921ZINFOtest_metrics (dropshot_external): request completed latency_us = 33351 local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 02516472-5b0f-4446-9e0d-18ec539c5a2a response_code = 201 uri = /v1/system/ip-pools
39512026-03-03T16:56:46.921ZINFOtest_metrics (external client test context): client received response status = 201
39522026-03-03T16:56:46.922ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:40151/v1/system/ip-pools/default-v6/ranges/add
39532026-03-03T16:56:46.922ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 uri = /v1/system/ip-pools/default-v6/ranges/add
39542026-03-03T16:56:46.922ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 uri = /v1/system/ip-pools/default-v6/ranges/add version = 2026021900.0.0
39552026-03-03T16:56:46.922ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 uri = /v1/system/ip-pools/default-v6/ranges/add
39562026-03-03T16:56:46.922ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v6/ranges/add
39572026-03-03T16:56:46.922ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39582026-03-03T16:56:46.922ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39592026-03-03T16:56:46.922ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39602026-03-03T16:56:46.924ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39612026-03-03T16:56:46.924ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39622026-03-03T16:56:46.924ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39632026-03-03T16:56:46.925ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
39642026-03-03T16:56:46.925ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
39652026-03-03T16:56:46.925ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39662026-03-03T16:56:46.925ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39672026-03-03T16:56:46.926ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39682026-03-03T16:56:46.927ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
39692026-03-03T16:56:46.927ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39702026-03-03T16:56:46.927ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39712026-03-03T16:56:46.927ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39722026-03-03T16:56:46.928ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39732026-03-03T16:56:46.930ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
39742026-03-03T16:56:46.930ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39752026-03-03T16:56:46.930ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39762026-03-03T16:56:46.931ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39772026-03-03T16:56:46.932ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
39782026-03-03T16:56:46.932ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
39792026-03-03T16:56:46.932ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39802026-03-03T16:56:46.932ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39812026-03-03T16:56:46.932ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39822026-03-03T16:56:46.933ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
39832026-03-03T16:56:46.933ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39842026-03-03T16:56:46.933ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39852026-03-03T16:56:46.933ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39862026-03-03T16:56:46.934ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39872026-03-03T16:56:46.936ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
39882026-03-03T16:56:46.936ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 uri = /v1/system/ip-pools/default-v6/ranges/add
39892026-03-03T16:56:46.936ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
39902026-03-03T16:56:46.936ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
39912026-03-03T16:56:46.936ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
39922026-03-03T16:56:46.936ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
39932026-03-03T16:56:46.937ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
39942026-03-03T16:56:46.938ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
39952026-03-03T16:56:46.939ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
39962026-03-03T16:56:46.939ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
39972026-03-03T16:56:46.940ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
39982026-03-03T16:56:46.940ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
39992026-03-03T16:56:46.943ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40002026-03-03T16:56:46.943ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40012026-03-03T16:56:46.943ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40022026-03-03T16:56:46.944ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = IpPool { parent: Fleet, key: c1639de3-ad94-45a0-aa93-e389727db1f7, lookup_type: ByName("default-v6") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40032026-03-03T16:56:46.945ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40042026-03-03T16:56:46.945ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40052026-03-03T16:56:46.945ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40062026-03-03T16:56:46.945ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40072026-03-03T16:56:46.946ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40082026-03-03T16:56:46.949ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = IpPool { parent: Fleet, key: c1639de3-ad94-45a0-aa93-e389727db1f7, lookup_type: ByName("default-v6") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40092026-03-03T16:56:46.949ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40102026-03-03T16:56:46.949ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40112026-03-03T16:56:46.949ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40122026-03-03T16:56:46.950ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40132026-03-03T16:56:46.950ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40142026-03-03T16:56:46.951ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40152026-03-03T16:56:46.951ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = IpPool { parent: Fleet, key: c1639de3-ad94-45a0-aa93-e389727db1f7, lookup_type: ByName("default-v6") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40162026-03-03T16:56:46.951ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40172026-03-03T16:56:46.951ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40182026-03-03T16:56:46.951ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40192026-03-03T16:56:46.952ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40202026-03-03T16:56:46.953ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40212026-03-03T16:56:46.955ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = IpPool { parent: Fleet, key: c1639de3-ad94-45a0-aa93-e389727db1f7, lookup_type: ByName("default-v6") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40222026-03-03T16:56:46.963ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40232026-03-03T16:56:46.963ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40242026-03-03T16:56:46.963ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40252026-03-03T16:56:46.963ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40262026-03-03T16:56:46.963ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40272026-03-03T16:56:46.969ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40282026-03-03T16:56:46.971ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40292026-03-03T16:56:46.971ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40302026-03-03T16:56:46.971ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40312026-03-03T16:56:46.971ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
40322026-03-03T16:56:46.973ZINFOtest_metrics (dropshot_external): request completed latency_us = 51412 local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 65373f6e-e892-4494-80d1-ebadbbca0746 response_code = 201 uri = /v1/system/ip-pools/default-v6/ranges/add
40332026-03-03T16:56:46.973ZINFOtest_metrics (external client test context): client received response status = 201
40342026-03-03T16:56:46.974ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:40151/v1/system/ip-pools/default-v6/silos
40352026-03-03T16:56:46.974ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 uri = /v1/system/ip-pools/default-v6/silos
40362026-03-03T16:56:46.974ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 uri = /v1/system/ip-pools/default-v6/silos version = 2026021900.0.0
40372026-03-03T16:56:46.974ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 uri = /v1/system/ip-pools/default-v6/silos
40382026-03-03T16:56:46.974ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v6/silos
40392026-03-03T16:56:46.974ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40402026-03-03T16:56:46.974ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40412026-03-03T16:56:46.975ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40422026-03-03T16:56:46.976ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40432026-03-03T16:56:46.976ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40442026-03-03T16:56:46.976ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40452026-03-03T16:56:46.977ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
40462026-03-03T16:56:46.978ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
40472026-03-03T16:56:46.978ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40482026-03-03T16:56:46.978ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40492026-03-03T16:56:46.978ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40502026-03-03T16:56:46.979ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40512026-03-03T16:56:46.979ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40522026-03-03T16:56:46.979ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40532026-03-03T16:56:46.979ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40542026-03-03T16:56:46.980ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40552026-03-03T16:56:46.983ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
40562026-03-03T16:56:46.983ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40572026-03-03T16:56:46.983ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40582026-03-03T16:56:46.983ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40592026-03-03T16:56:46.990ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
40602026-03-03T16:56:46.990ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
40612026-03-03T16:56:46.990ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40622026-03-03T16:56:46.990ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40632026-03-03T16:56:46.990ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40642026-03-03T16:56:46.991ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40652026-03-03T16:56:46.991ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40662026-03-03T16:56:46.991ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40672026-03-03T16:56:46.992ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40682026-03-03T16:56:46.993ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40692026-03-03T16:56:46.995ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
40702026-03-03T16:56:46.995ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 uri = /v1/system/ip-pools/default-v6/silos
40712026-03-03T16:56:46.995ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40722026-03-03T16:56:46.995ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40732026-03-03T16:56:46.995ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40742026-03-03T16:56:46.995ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40752026-03-03T16:56:46.995ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40762026-03-03T16:56:46.997ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40772026-03-03T16:56:47.002ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40782026-03-03T16:56:47.002ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40792026-03-03T16:56:47.002ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40802026-03-03T16:56:47.002ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40812026-03-03T16:56:47.004ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40822026-03-03T16:56:47.004ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40832026-03-03T16:56:47.004ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40842026-03-03T16:56:47.006ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = IpPool { parent: Fleet, key: c1639de3-ad94-45a0-aa93-e389727db1f7, lookup_type: ByName("default-v6") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40852026-03-03T16:56:47.006ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40862026-03-03T16:56:47.006ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40872026-03-03T16:56:47.006ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40882026-03-03T16:56:47.006ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40892026-03-03T16:56:47.008ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40902026-03-03T16:56:47.011ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = IpPool { parent: Fleet, key: c1639de3-ad94-45a0-aa93-e389727db1f7, lookup_type: ByName("default-v6") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40912026-03-03T16:56:47.011ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40922026-03-03T16:56:47.011ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40932026-03-03T16:56:47.011ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40942026-03-03T16:56:47.013ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40952026-03-03T16:56:47.013ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40962026-03-03T16:56:47.013ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40972026-03-03T16:56:47.014ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40982026-03-03T16:56:47.015ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
40992026-03-03T16:56:47.015ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41002026-03-03T16:56:47.015ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41012026-03-03T16:56:47.015ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41022026-03-03T16:56:47.016ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41032026-03-03T16:56:47.016ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41042026-03-03T16:56:47.016ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41052026-03-03T16:56:47.017ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41062026-03-03T16:56:47.018ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41072026-03-03T16:56:47.020ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41082026-03-03T16:56:47.022ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41092026-03-03T16:56:47.022ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41102026-03-03T16:56:47.022ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41112026-03-03T16:56:47.022ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41122026-03-03T16:56:47.022ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41132026-03-03T16:56:47.022ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41142026-03-03T16:56:47.025ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41152026-03-03T16:56:47.025ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41162026-03-03T16:56:47.025ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41172026-03-03T16:56:47.025ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41182026-03-03T16:56:47.042ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41192026-03-03T16:56:47.042ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41202026-03-03T16:56:47.042ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41212026-03-03T16:56:47.042ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41222026-03-03T16:56:47.042ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41232026-03-03T16:56:47.057ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41242026-03-03T16:56:47.058ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41252026-03-03T16:56:47.058ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41262026-03-03T16:56:47.059ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41272026-03-03T16:56:47.059ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
41282026-03-03T16:56:47.061ZINFOtest_metrics (dropshot_external): request completed latency_us = 87311 local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = e321f673-1ddb-48af-8863-da37d9d89297 response_code = 201 uri = /v1/system/ip-pools/default-v6/silos
41292026-03-03T16:56:47.062ZINFOtest_metrics (external client test context): client received response status = 201
41302026-03-03T16:56:47.062ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40651 method = GET path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
41312026-03-03T16:56:47.062ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40651 method = POST path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
41322026-03-03T16:56:47.062ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40651 method = DELETE path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
41332026-03-03T16:56:47.062ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40651 method = GET path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
41342026-03-03T16:56:47.062ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40651 method = GET path = /crucible/0/regions/{id}/snapshots server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
41352026-03-03T16:56:47.062ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40651 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
41362026-03-03T16:56:47.062ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40651 method = GET path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
41372026-03-03T16:56:47.062ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40651 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
41382026-03-03T16:56:47.062ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40651 method = POST path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
41392026-03-03T16:56:47.062ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): listening kind = storage local_addr = [::1]:40651 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
41402026-03-03T16:56:47.062ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): successfully registered DTrace USDT probes kind = storage local_addr = [::1]:40651 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
41412026-03-03T16:56:47.062ZINFOtest_metrics (SledAgent): Created Simulated Crucible Server address = [::1]:40651 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
41422026-03-03T16:56:47.062ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = b5868515-c5d4-43b2-9464-0e5bba92381c serial = totally-unique-serial: b5868515-c5d4-43b2-9464-0e5bba92381c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
41432026-03-03T16:56:47.062ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41442026-03-03T16:56:47.063ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41452026-03-03T16:56:47.063ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
41462026-03-03T16:56:47.065ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41472026-03-03T16:56:47.065ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41482026-03-03T16:56:47.065ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
41492026-03-03T16:56:47.066ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
41502026-03-03T16:56:47.067ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41512026-03-03T16:56:47.067ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41522026-03-03T16:56:47.067ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41532026-03-03T16:56:47.067ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
41542026-03-03T16:56:47.068ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41552026-03-03T16:56:47.071ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
41562026-03-03T16:56:47.166ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = b5868515-c5d4-43b2-9464-0e5bba92381c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = f9f58350-3473-4926-9fe3-e28dd584f1e9
41572026-03-03T16:56:47.166ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41582026-03-03T16:56:47.166ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41592026-03-03T16:56:47.167ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
41602026-03-03T16:56:47.167ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
41612026-03-03T16:56:47.168ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41622026-03-03T16:56:47.168ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41632026-03-03T16:56:47.168ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41642026-03-03T16:56:47.168ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
41652026-03-03T16:56:47.169ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41662026-03-03T16:56:47.173ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
41672026-03-03T16:56:47.179ZINFOtest_metrics (nexus): upserting Crucible dataset dataset_id = dc12e425-55fd-4e07-a830-103c3c369848 zpool_id = f9f58350-3473-4926-9fe3-e28dd584f1e9
41682026-03-03T16:56:47.185ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = b5868515-c5d4-43b2-9464-0e5bba92381c serial = totally-unique-serial: b5868515-c5d4-43b2-9464-0e5bba92381c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
41692026-03-03T16:56:47.185ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41702026-03-03T16:56:47.185ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41712026-03-03T16:56:47.186ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
41722026-03-03T16:56:47.187ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: b5868515-c5d4-43b2-9464-0e5bba92381c (physical_disk), lookup_type: ById(b5868515-c5d4-43b2-9464-0e5bba92381c) }
41732026-03-03T16:56:47.187ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41742026-03-03T16:56:47.188ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41752026-03-03T16:56:47.188ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41762026-03-03T16:56:47.188ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
41772026-03-03T16:56:47.189ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41782026-03-03T16:56:47.193ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: b5868515-c5d4-43b2-9464-0e5bba92381c (physical_disk), lookup_type: ById(b5868515-c5d4-43b2-9464-0e5bba92381c) } result = Ok(())
41792026-03-03T16:56:47.193ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = b5868515-c5d4-43b2-9464-0e5bba92381c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = f9f58350-3473-4926-9fe3-e28dd584f1e9
41802026-03-03T16:56:47.193ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41812026-03-03T16:56:47.193ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41822026-03-03T16:56:47.194ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
41832026-03-03T16:56:47.196ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
41842026-03-03T16:56:47.196ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41852026-03-03T16:56:47.196ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41862026-03-03T16:56:47.196ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41872026-03-03T16:56:47.197ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
41882026-03-03T16:56:47.198ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41892026-03-03T16:56:47.200ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
41902026-03-03T16:56:47.203ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
41912026-03-03T16:56:47.203ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41922026-03-03T16:56:47.203ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41932026-03-03T16:56:47.203ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41942026-03-03T16:56:47.204ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
41952026-03-03T16:56:47.205ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41962026-03-03T16:56:47.208ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
41972026-03-03T16:56:47.208ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
41982026-03-03T16:56:47.208ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
41992026-03-03T16:56:47.208ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
42002026-03-03T16:56:47.210ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
42012026-03-03T16:56:47.210ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42022026-03-03T16:56:47.210ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
42032026-03-03T16:56:47.210ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
42042026-03-03T16:56:47.211ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
42052026-03-03T16:56:47.213ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Signaled
42062026-03-03T16:56:47.213ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
42072026-03-03T16:56:47.213ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42082026-03-03T16:56:47.213ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
42092026-03-03T16:56:47.213ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42102026-03-03T16:56:47.214ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
42112026-03-03T16:56:47.215ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42122026-03-03T16:56:47.219ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
42132026-03-03T16:56:47.219ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
42142026-03-03T16:56:47.220ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
42152026-03-03T16:56:47.220ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
42162026-03-03T16:56:47.220ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42172026-03-03T16:56:47.223ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
42182026-03-03T16:56:47.223ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
42192026-03-03T16:56:47.223ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42202026-03-03T16:56:47.224ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
42212026-03-03T16:56:47.225ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
42222026-03-03T16:56:47.225ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
42232026-03-03T16:56:47.225ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
42242026-03-03T16:56:47.226ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(167f54a0-df78-49db-aee7-111ed892ca3f, 2)]
42252026-03-03T16:56:47.226ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
42262026-03-03T16:56:47.227ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: e0 3d 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 .=..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:39697 req_id = 5ac2ecdc-bd3f-436d-905c-1b7842c99ca4
42272026-03-03T16:56:47.227ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 57405,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:39697 req_id = 5ac2ecdc-bd3f-436d-905c-1b7842c99ca4
42282026-03-03T16:56:47.227ZDEBGtest_metrics (store): query key key = _mgs._tcp
42292026-03-03T16:56:47.227ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
42302026-03-03T16:56:47.227ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:39697 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 5ac2ecdc-bd3f-436d-905c-1b7842c99ca4
42312026-03-03T16:56:47.227ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1869, tv_nsec: 484201243 } })
42322026-03-03T16:56:47.227ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
42332026-03-03T16:56:47.228ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 94 e2 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:1411 req_id = 80262f42-1403-44e5-a158-786da179c7d9
42342026-03-03T16:56:47.228ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 38114,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:1411 req_id = 80262f42-1403-44e5-a158-786da179c7d9
42352026-03-03T16:56:47.228ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
42362026-03-03T16:56:47.228ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:1411 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 80262f42-1403-44e5-a158-786da179c7d9
42372026-03-03T16:56:47.239ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
42382026-03-03T16:56:47.239ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 1f 91 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:53271 req_id = cd3d3699-9c33-4734-a601-8121ae6db4dc
42392026-03-03T16:56:47.239ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 8081,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:53271 req_id = cd3d3699-9c33-4734-a601-8121ae6db4dc
42402026-03-03T16:56:47.240ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
42412026-03-03T16:56:47.240ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8081, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:53271 req_id = cd3d3699-9c33-4734-a601-8121ae6db4dc
42422026-03-03T16:56:47.240ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
42432026-03-03T16:56:47.240ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: b0 c7 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f ............._co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:15975 req_id = b6bc35ff-546c-4b1d-982f-759ebb565fc1
42442026-03-03T16:56:47.240ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 45255,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:15975 req_id = b6bc35ff-546c-4b1d-982f-759ebb565fc1
42452026-03-03T16:56:47.240ZDEBGtest_metrics (store): query key key = _cockroach._tcp
42462026-03-03T16:56:47.240ZDEBGtest_metrics (store): query key key = 5003bd5e-8cef-4ba6-a473-d7948135a715.host
42472026-03-03T16:56:47.240ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:15975 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32943, target: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal") }) }] req_id = b6bc35ff-546c-4b1d-982f-759ebb565fc1
42482026-03-03T16:56:47.241ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32943, target: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1869, tv_nsec: 497731474 } })
42492026-03-03T16:56:47.241ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
42502026-03-03T16:56:47.241ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 63 18 01 00 00 01 00 00 00 00 00 01 24 35 30 30 c...........$500\n0010: 33 62 64 35 65 2d 38 63 65 66 2d 34 62 61 36 2d 3bd5e-8cef-4ba6-\n0020: 61 34 37 33 2d 64 37 39 34 38 31 33 35 61 37 31 a473-d7948135a71\n0030: 35 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 5.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:33217 req_id = 3d0b30da-a1a6-4c7a-8ab5-d54471d9774e
42512026-03-03T16:56:47.241ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25368,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 53,\n 48,\n 48,\n 51,\n 98,\n 100,\n 53,\n 101,\n 45,\n 56,\n 99,\n 101,\n 102,\n 45,\n 52,\n 98,\n 97,\n 54,\n 45,\n 97,\n 52,\n 55,\n 51,\n 45,\n 100,\n 55,\n 57,\n 52,\n 56,\n 49,\n 51,\n 53,\n 97,\n 55,\n 49,\n 53,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:33217 req_id = 3d0b30da-a1a6-4c7a-8ab5-d54471d9774e
42522026-03-03T16:56:47.241ZDEBGtest_metrics (store): query key key = 5003bd5e-8cef-4ba6-a473-d7948135a715.host
42532026-03-03T16:56:47.241ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:33217 query = LowerQuery { name: LowerName(Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal.")), original: Query { name: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 3d0b30da-a1a6-4c7a-8ab5-d54471d9774e
42542026-03-03T16:56:47.241ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
42552026-03-03T16:56:47.241ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:36753
42562026-03-03T16:56:47.241ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/ignition
42572026-03-03T16:56:47.243ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "414ac931-be97-44f4-a435-609c0e5c8cff", "content-length": "835", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42582026-03-03T16:56:47.243ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0
42592026-03-03T16:56:47.244ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8add729f-8cb2-4157-9334-bb66b4a98446", "content-length": "734", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42602026-03-03T16:56:47.244ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=0
42612026-03-03T16:56:47.245ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9db6c03d-5b64-4bbd-a0c6-b7ead58604c6", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42622026-03-03T16:56:47.245ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=1
42632026-03-03T16:56:47.246ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebfc2849-c6d8-45ec-99a9-b6a996e217e1", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42642026-03-03T16:56:47.246ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=0
42652026-03-03T16:56:47.247ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1eb3b7e-1618-43e3-9c0b-d45f4e31889f", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42662026-03-03T16:56:47.247ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=1
42672026-03-03T16:56:47.248ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffd8d9d8-eead-4916-a614-99c6a69da6cd", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42682026-03-03T16:56:47.248ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=0
42692026-03-03T16:56:47.249ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaafdd16-a383-4f69-bf04-76906fe520ca", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42702026-03-03T16:56:47.249ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=1
42712026-03-03T16:56:47.250ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "71acf389-47b7-4028-9907-edf831c1a095", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42722026-03-03T16:56:47.250ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cmpa
42732026-03-03T16:56:47.250ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "63a0d2ac-ea2d-4cea-a386-cf663f608244", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42742026-03-03T16:56:47.250ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
42752026-03-03T16:56:47.251ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "91d13620-c571-4554-a960-9f028ba62345", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42762026-03-03T16:56:47.251ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
42772026-03-03T16:56:47.252ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e47bac9-3ae1-4124-bc3d-8682a0929e45", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42782026-03-03T16:56:47.252ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
42792026-03-03T16:56:47.253ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdcb5871-f54e-4f24-945f-1b3365dac8d5", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42802026-03-03T16:56:47.253ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1
42812026-03-03T16:56:47.253ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddabebe4-c763-45d2-b312-50f4269ae632", "content-length": "734", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42822026-03-03T16:56:47.254ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=0
42832026-03-03T16:56:47.254ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e71b773f-369c-4e6d-8f2d-5726445eec12", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42842026-03-03T16:56:47.255ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=1
42852026-03-03T16:56:47.256ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "187cd181-cdac-40f4-be1c-2e640b1da8df", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42862026-03-03T16:56:47.256ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=0
42872026-03-03T16:56:47.256ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d23f03a-41de-480a-8878-3f96c728580b", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42882026-03-03T16:56:47.256ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=1
42892026-03-03T16:56:47.257ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf7172d9-a974-49ca-b829-4bbb1d4226ad", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42902026-03-03T16:56:47.257ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=0
42912026-03-03T16:56:47.258ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d254c998-9182-44b8-8c1d-f23b58a51cad", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42922026-03-03T16:56:47.258ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=1
42932026-03-03T16:56:47.259ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "26519174-4e8f-4a3a-8cfd-af8678ecc7dd", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42942026-03-03T16:56:47.259ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cmpa
42952026-03-03T16:56:47.259ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c937b312-a3e4-48d8-b020-618c8a59eef2", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42962026-03-03T16:56:47.259ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
42972026-03-03T16:56:47.260ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9c76b33-b857-4964-a8cb-cabbabcb5afa", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
42982026-03-03T16:56:47.260ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
42992026-03-03T16:56:47.261ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd491494-e2a3-42b1-9da3-9e361d627821", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43002026-03-03T16:56:47.261ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
43012026-03-03T16:56:47.261ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "194dd170-7980-4d53-ad52-dcc8c30f500a", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43022026-03-03T16:56:47.261ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0
43032026-03-03T16:56:47.262ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca9a3bd7-6c73-411f-bd5e-4a3eef6caf9c", "content-length": "723", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43042026-03-03T16:56:47.262ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/active-slot
43052026-03-03T16:56:47.263ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
43062026-03-03T16:56:47.263ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d08a43d-ca59-488f-a44a-52ba94e3c0a3", "content-length": "10", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43072026-03-03T16:56:47.263ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/0
43082026-03-03T16:56:47.264ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dab2140c-8bf4-433e-8526-6c129e506672", "content-length": "144", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43092026-03-03T16:56:47.264ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/1
43102026-03-03T16:56:47.264ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bd15f02-5395-4b7c-bf03-fb8b36d60d83", "content-length": "147", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43112026-03-03T16:56:47.264ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=0
43122026-03-03T16:56:47.265ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "80726f61-be8e-4e46-b777-8e6e3db3f069", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43132026-03-03T16:56:47.266ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=1
43142026-03-03T16:56:47.266ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "18cb01aa-279d-4c73-bc83-a7a9d3f27456", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43152026-03-03T16:56:47.266ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=0
43162026-03-03T16:56:47.266ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d79a336f-250d-495c-8dba-3c35cce9be48", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43172026-03-03T16:56:47.267ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=1
43182026-03-03T16:56:47.267ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1b15340-f44e-457a-b37c-2cdcb39ed426", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43192026-03-03T16:56:47.267ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=0
43202026-03-03T16:56:47.268ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8006260-9b62-4732-91fa-f416812bdc1d", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43212026-03-03T16:56:47.268ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=1
43222026-03-03T16:56:47.269ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a028297f-047a-4d9b-bb96-0726c7113168", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43232026-03-03T16:56:47.269ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cmpa
43242026-03-03T16:56:47.269ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7986fa11-00af-40a9-bc5a-c75abbd34cca", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43252026-03-03T16:56:47.270ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
43262026-03-03T16:56:47.270ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d899a46b-8c62-481a-a99f-0d76619682fe", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43272026-03-03T16:56:47.270ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
43282026-03-03T16:56:47.270ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0dedef0-c3a9-4348-9cd5-00fca24d58ee", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43292026-03-03T16:56:47.270ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
43302026-03-03T16:56:47.271ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "94bfb4f6-be93-4ec4-ad9d-4fe5062559de", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43312026-03-03T16:56:47.271ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1
43322026-03-03T16:56:47.272ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff5c888d-b7ef-4a96-9e38-da2fc42a7f0a", "content-length": "723", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43332026-03-03T16:56:47.272ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/active-slot
43342026-03-03T16:56:47.273ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2f6c3b4-e304-4570-91f9-ac242aa576a8", "content-length": "10", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43352026-03-03T16:56:47.273ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/0
43362026-03-03T16:56:47.273ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3eea458-57a6-4d0e-b9ea-a1ec66c80623", "content-length": "144", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43372026-03-03T16:56:47.273ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/1
43382026-03-03T16:56:47.273ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbcd1a96-5c49-4147-aa1b-8e33fad896d9", "content-length": "147", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43392026-03-03T16:56:47.273ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=0
43402026-03-03T16:56:47.274ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb23b9b1-420a-4344-9954-54a18239d009", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43412026-03-03T16:56:47.274ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=1
43422026-03-03T16:56:47.275ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0523ec0-5ba3-4763-8e07-99b9ab7325c6", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43432026-03-03T16:56:47.275ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=0
43442026-03-03T16:56:47.275ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e7de905-9a98-48ab-aa04-1d535fec599c", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43452026-03-03T16:56:47.275ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=1
43462026-03-03T16:56:47.276ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9de8cd8-0fc3-49b9-b65d-58df7121a424", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43472026-03-03T16:56:47.276ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=0
43482026-03-03T16:56:47.277ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4cfdd67-7d8e-47bc-90fc-cd56d74fe387", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43492026-03-03T16:56:47.277ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=1
43502026-03-03T16:56:47.277ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "35e3e11c-5892-4138-b457-e7a7e3b99279", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43512026-03-03T16:56:47.277ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cmpa
43522026-03-03T16:56:47.278ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c0c4631-663c-44ef-a2d5-6b717181c058", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43532026-03-03T16:56:47.278ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
43542026-03-03T16:56:47.278ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "103594d1-319f-4f2a-a487-20be89a620aa", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43552026-03-03T16:56:47.279ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
43562026-03-03T16:56:47.279ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "40affa23-094a-486e-bc7b-dde87316c20d", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43572026-03-03T16:56:47.279ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
43582026-03-03T16:56:47.280ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dd3c131-34b9-459a-98c8-178349a9d90f", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43592026-03-03T16:56:47.280ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
43602026-03-03T16:56:47.280ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
43612026-03-03T16:56:47.280ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
43622026-03-03T16:56:47.280ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43632026-03-03T16:56:47.280ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
43642026-03-03T16:56:47.282ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43652026-03-03T16:56:47.285ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
43662026-03-03T16:56:47.285ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
43672026-03-03T16:56:47.285ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
43682026-03-03T16:56:47.285ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
43692026-03-03T16:56:47.285ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43702026-03-03T16:56:47.285ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
43712026-03-03T16:56:47.287ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43722026-03-03T16:56:47.290ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
43732026-03-03T16:56:47.290ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
43742026-03-03T16:56:47.290ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43752026-03-03T16:56:47.291ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
43762026-03-03T16:56:47.302ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:33115
43772026-03-03T16:56:47.302ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:33115 background_task = inventory_collection body = None method = GET uri = http://[::1]:33115/inventory
43782026-03-03T16:56:47.303ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47676 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
43792026-03-03T16:56:47.303ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = GET remote_addr = [::1]:47676 req_id = 722a73d0-e590-444b-ac48-500d060fbf27 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
43802026-03-03T16:56:47.303ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = GET remote_addr = [::1]:47676 req_id = 722a73d0-e590-444b-ac48-500d060fbf27 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
43812026-03-03T16:56:47.304ZINFOtest_metrics (dropshot): request completed latency_us = 1139 local_addr = [::1]:33115 method = GET remote_addr = [::1]:47676 req_id = 722a73d0-e590-444b-ac48-500d060fbf27 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
43822026-03-03T16:56:47.304ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:33115 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:33115/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "722a73d0-e590-444b-ac48-500d060fbf27", "content-length": "20979", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
43832026-03-03T16:56:47.306ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
43842026-03-03T16:56:47.306ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
43852026-03-03T16:56:47.306ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
43862026-03-03T16:56:47.306ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
43872026-03-03T16:56:47.306ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
43882026-03-03T16:56:47.306ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
43892026-03-03T16:56:47.315ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 00202f40-5fe9-436d-80ec-5125a4b6d9f1 (omicron_zone)
43902026-03-03T16:56:47.315ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
43912026-03-03T16:56:47.315ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
43922026-03-03T16:56:47.315ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
43932026-03-03T16:56:47.315ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
43942026-03-03T16:56:47.315ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
43952026-03-03T16:56:47.316ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
43962026-03-03T16:56:47.316ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
43972026-03-03T16:56:47.316ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
43982026-03-03T16:56:47.325ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 5af26469-64ce-4f90-bbd5-93c35e3638d1 (omicron_zone)
43992026-03-03T16:56:47.325ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:43957 method = GET uri = http://[::1]:43957/config
44002026-03-03T16:56:47.326ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:43957 remote_addr = [::1]:55844
44012026-03-03T16:56:47.326ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:43957 method = GET remote_addr = [::1]:55844 req_id = 9a8cf448-8bfc-44cb-8f17-8cc6658c4048 uri = /config
44022026-03-03T16:56:47.326ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:43957 method = GET remote_addr = [::1]:55844 req_id = 9a8cf448-8bfc-44cb-8f17-8cc6658c4048 uri = /config version = 2.0.0
44032026-03-03T16:56:47.326ZINFOtest_metrics (http): request completed kind = dns latency_us = 566 local_addr = [::1]:43957 method = GET remote_addr = [::1]:55844 req_id = 9a8cf448-8bfc-44cb-8f17-8cc6658c4048 response_code = 200 uri = /config
44042026-03-03T16:56:47.327ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:43957 result = Ok(Response { url: "http://[::1]:43957/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a8cf448-8bfc-44cb-8f17-8cc6658c4048", "content-length": "3478", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
44052026-03-03T16:56:47.327ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 5af26469-64ce-4f90-bbd5-93c35e3638d1 (omicron_zone)
44062026-03-03T16:56:47.327ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
44072026-03-03T16:56:47.327ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
44082026-03-03T16:56:47.327ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
44092026-03-03T16:56:47.327ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44102026-03-03T16:56:47.327ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
44112026-03-03T16:56:47.327ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44122026-03-03T16:56:47.328ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
44132026-03-03T16:56:47.329ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44142026-03-03T16:56:47.332ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
44152026-03-03T16:56:47.332ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
44162026-03-03T16:56:47.332ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
44172026-03-03T16:56:47.333ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
44182026-03-03T16:56:47.334ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44192026-03-03T16:56:47.337ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
44202026-03-03T16:56:47.337ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
44212026-03-03T16:56:47.337ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44222026-03-03T16:56:47.338ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
44232026-03-03T16:56:47.338ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
44242026-03-03T16:56:47.338ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
44252026-03-03T16:56:47.339ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
44262026-03-03T16:56:47.371ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
44272026-03-03T16:56:47.422ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
44282026-03-03T16:56:47.422ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44292026-03-03T16:56:47.422ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
44302026-03-03T16:56:47.422ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
44312026-03-03T16:56:47.423ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
44322026-03-03T16:56:47.424ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44332026-03-03T16:56:47.428ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
44342026-03-03T16:56:47.428ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
44352026-03-03T16:56:47.428ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
44362026-03-03T16:56:47.429ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
44372026-03-03T16:56:47.471ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = e8669a74-a33a-40c9-8ae0-615aafa41c7d
44382026-03-03T16:56:47.471ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = e8669a74-a33a-40c9-8ae0-615aafa41c7d time_started = 2026-03-03 16:56:47.241842 UTC
44392026-03-03T16:56:47.471ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 258.38918ms iteration = 4 status = {"collection_id":"e8669a74-a33a-40c9-8ae0-615aafa41c7d","time_done":"2026-03-03 16:56:47.327512 UTC","time_started":"2026-03-03 16:56:47.241842 UTC"}
44402026-03-03T16:56:47.472ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 5 reason = Signaled
44412026-03-03T16:56:47.472ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
44422026-03-03T16:56:47.472ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44432026-03-03T16:56:47.472ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
44442026-03-03T16:56:47.472ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44452026-03-03T16:56:47.472ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
44462026-03-03T16:56:47.473ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 3 reason = Dependency
44472026-03-03T16:56:47.473ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
44482026-03-03T16:56:47.473ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44492026-03-03T16:56:47.473ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
44502026-03-03T16:56:47.473ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
44512026-03-03T16:56:47.473ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
44522026-03-03T16:56:47.474ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
44532026-03-03T16:56:47.474ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
44542026-03-03T16:56:47.474ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
44552026-03-03T16:56:47.475ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44562026-03-03T16:56:47.478ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
44572026-03-03T16:56:47.478ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
44582026-03-03T16:56:47.478ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44592026-03-03T16:56:47.478ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
44602026-03-03T16:56:47.479ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44612026-03-03T16:56:47.483ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
44622026-03-03T16:56:47.483ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
44632026-03-03T16:56:47.483ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
44642026-03-03T16:56:47.483ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
44652026-03-03T16:56:47.484ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
44662026-03-03T16:56:47.484ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
44672026-03-03T16:56:47.484ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
44682026-03-03T16:56:47.485ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(167f54a0-df78-49db-aee7-111ed892ca3f, 2), (e8669a74-a33a-40c9-8ae0-615aafa41c7d, 2)]
44692026-03-03T16:56:47.485ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
44702026-03-03T16:56:47.485ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: c2 8f 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:42704 req_id = 18909d27-f755-4671-a244-37535a424be2
44712026-03-03T16:56:47.485ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 49807,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:42704 req_id = 18909d27-f755-4671-a244-37535a424be2
44722026-03-03T16:56:47.485ZDEBGtest_metrics (store): query key key = _mgs._tcp
44732026-03-03T16:56:47.485ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
44742026-03-03T16:56:47.486ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:42704 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 18909d27-f755-4671-a244-37535a424be2
44752026-03-03T16:56:47.486ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1869, tv_nsec: 742750634 } })
44762026-03-03T16:56:47.486ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
44772026-03-03T16:56:47.486ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 51 9d 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e Q...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:49491 req_id = ef0dd779-0eb3-4133-8a30-70f9e5c722c1
44782026-03-03T16:56:47.486ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 20893,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:49491 req_id = ef0dd779-0eb3-4133-8a30-70f9e5c722c1
44792026-03-03T16:56:47.486ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
44802026-03-03T16:56:47.486ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:49491 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = ef0dd779-0eb3-4133-8a30-70f9e5c722c1
44812026-03-03T16:56:47.495ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
44822026-03-03T16:56:47.496ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 70 a2 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c p............_cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:52325 req_id = a5a8d93f-0c6f-45f6-a69b-8b4a94b0bbcd
44832026-03-03T16:56:47.496ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 28834,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:52325 req_id = a5a8d93f-0c6f-45f6-a69b-8b4a94b0bbcd
44842026-03-03T16:56:47.496ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
44852026-03-03T16:56:47.496ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28834, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:52325 req_id = a5a8d93f-0c6f-45f6-a69b-8b4a94b0bbcd
44862026-03-03T16:56:47.496ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
44872026-03-03T16:56:47.496ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: ee 5f 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f ._..........._co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:1976 req_id = 6c1e7827-40d0-4606-b3cf-44357290deeb
44882026-03-03T16:56:47.496ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 61023,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:1976 req_id = 6c1e7827-40d0-4606-b3cf-44357290deeb
44892026-03-03T16:56:47.496ZDEBGtest_metrics (store): query key key = _cockroach._tcp
44902026-03-03T16:56:47.496ZDEBGtest_metrics (store): query key key = 5003bd5e-8cef-4ba6-a473-d7948135a715.host
44912026-03-03T16:56:47.496ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:1976 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32943, target: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal") }) }] req_id = 6c1e7827-40d0-4606-b3cf-44357290deeb
44922026-03-03T16:56:47.496ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32943, target: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1869, tv_nsec: 753412981 } })
44932026-03-03T16:56:47.497ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
44942026-03-03T16:56:47.497ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: f2 4c 01 00 00 01 00 00 00 00 00 01 24 35 30 30 .L..........$500\n0010: 33 62 64 35 65 2d 38 63 65 66 2d 34 62 61 36 2d 3bd5e-8cef-4ba6-\n0020: 61 34 37 33 2d 64 37 39 34 38 31 33 35 61 37 31 a473-d7948135a71\n0030: 35 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 5.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:28866 req_id = ecba4bf3-b74b-4305-a905-c43b4b672ba9
44952026-03-03T16:56:47.497ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62028,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 53,\n 48,\n 48,\n 51,\n 98,\n 100,\n 53,\n 101,\n 45,\n 56,\n 99,\n 101,\n 102,\n 45,\n 52,\n 98,\n 97,\n 54,\n 45,\n 97,\n 52,\n 55,\n 51,\n 45,\n 100,\n 55,\n 57,\n 52,\n 56,\n 49,\n 51,\n 53,\n 97,\n 55,\n 49,\n 53,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:28866 req_id = ecba4bf3-b74b-4305-a905-c43b4b672ba9
44962026-03-03T16:56:47.497ZDEBGtest_metrics (store): query key key = 5003bd5e-8cef-4ba6-a473-d7948135a715.host
44972026-03-03T16:56:47.497ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:28866 query = LowerQuery { name: LowerName(Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal.")), original: Query { name: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = ecba4bf3-b74b-4305-a905-c43b4b672ba9
44982026-03-03T16:56:47.497ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
44992026-03-03T16:56:47.497ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:36753
45002026-03-03T16:56:47.497ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/ignition
45012026-03-03T16:56:47.499ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a21e854-42fd-41fd-b91a-601b14f8e04e", "content-length": "835", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45022026-03-03T16:56:47.499ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0
45032026-03-03T16:56:47.500ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "58f3090e-16bd-4321-ab44-76364a813be7", "content-length": "734", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45042026-03-03T16:56:47.500ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=0
45052026-03-03T16:56:47.501ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "28221fb3-0031-495a-81b3-8f9fb2f00319", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45062026-03-03T16:56:47.501ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=1
45072026-03-03T16:56:47.502ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb63d4d2-3e6e-46d4-a7a8-32e50f6181b5", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45082026-03-03T16:56:47.502ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=0
45092026-03-03T16:56:47.503ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7960485-9afe-4e0d-842b-e9f90a0494fe", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45102026-03-03T16:56:47.503ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=1
45112026-03-03T16:56:47.503ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
45122026-03-03T16:56:47.503ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
45132026-03-03T16:56:47.504ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c205a9b5-9e4f-49ab-b333-c97e8ffb4873", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45142026-03-03T16:56:47.504ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=0
45152026-03-03T16:56:47.505ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "713e54f7-7c57-48d0-bb87-f4b61d7181a5", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45162026-03-03T16:56:47.505ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=1
45172026-03-03T16:56:47.505ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "23ea3ab4-43b2-40e4-b6aa-9216bf08f878", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45182026-03-03T16:56:47.505ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cmpa
45192026-03-03T16:56:47.506ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6f1a422-9d0f-49b8-a495-c6f09d275493", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45202026-03-03T16:56:47.506ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
45212026-03-03T16:56:47.508ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f0121db-1744-4d3e-875d-8aff5ace36d9", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45222026-03-03T16:56:47.508ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
45232026-03-03T16:56:47.508ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "92ae8d66-22ef-4aed-9df5-aa5e59d2cba1", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45242026-03-03T16:56:47.508ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
45252026-03-03T16:56:47.509ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed8a4549-8818-4f8a-bd01-f4fe5db37005", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45262026-03-03T16:56:47.509ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1
45272026-03-03T16:56:47.510ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1131c853-a142-48fc-af70-5f5953c81847", "content-length": "734", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45282026-03-03T16:56:47.510ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=0
45292026-03-03T16:56:47.511ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "238aa892-2aab-466e-adfe-15901b2b4165", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45302026-03-03T16:56:47.511ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=1
45312026-03-03T16:56:47.512ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d98fc0d-c4c9-432b-bdbd-1cf5c6ad0dbe", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45322026-03-03T16:56:47.512ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=0
45332026-03-03T16:56:47.512ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1b5c7da-5a90-46a2-8be0-955065d66d61", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45342026-03-03T16:56:47.512ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=1
45352026-03-03T16:56:47.513ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f623937-36a7-4e55-b5fd-810a521ae235", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45362026-03-03T16:56:47.513ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=0
45372026-03-03T16:56:47.514ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "98359d4c-ddec-4913-adf0-e481a1753479", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45382026-03-03T16:56:47.514ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=1
45392026-03-03T16:56:47.515ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcd16627-54b3-47ce-ae83-d96e6fffc6ec", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45402026-03-03T16:56:47.515ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cmpa
45412026-03-03T16:56:47.515ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4f8966d-c6a4-4954-82d8-e4564024d313", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45422026-03-03T16:56:47.515ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
45432026-03-03T16:56:47.516ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e722d5c3-1f17-4271-9372-bd428a875287", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45442026-03-03T16:56:47.516ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
45452026-03-03T16:56:47.516ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3492ff4-0b81-4cc9-b398-c412a33434c9", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45462026-03-03T16:56:47.517ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
45472026-03-03T16:56:47.517ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "54823466-313c-463c-a00e-ed9b94f3297c", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45482026-03-03T16:56:47.517ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0
45492026-03-03T16:56:47.518ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "41d842a3-9ca6-4290-b1e9-b6f84c4f0f6e", "content-length": "723", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45502026-03-03T16:56:47.518ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/active-slot
45512026-03-03T16:56:47.518ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecdb313c-98eb-4635-92b1-e6c06ac96f32", "content-length": "10", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45522026-03-03T16:56:47.518ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/0
45532026-03-03T16:56:47.519ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a06cab03-62ba-4496-be0c-00408389b024", "content-length": "144", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45542026-03-03T16:56:47.519ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/1
45552026-03-03T16:56:47.520ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d32a70e-eb61-46b4-9a35-371cb97e3e34", "content-length": "147", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45562026-03-03T16:56:47.520ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=0
45572026-03-03T16:56:47.520ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cbb0387-74f0-457b-92cd-750b32b11e17", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45582026-03-03T16:56:47.520ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=1
45592026-03-03T16:56:47.522ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
45602026-03-03T16:56:47.522ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40043 method = GET path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45612026-03-03T16:56:47.522ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40043 method = POST path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45622026-03-03T16:56:47.522ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40043 method = DELETE path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45632026-03-03T16:56:47.522ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40043 method = GET path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45642026-03-03T16:56:47.522ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40043 method = GET path = /crucible/0/regions/{id}/snapshots server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45652026-03-03T16:56:47.522ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40043 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45662026-03-03T16:56:47.522ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40043 method = GET path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45672026-03-03T16:56:47.522ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40043 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45682026-03-03T16:56:47.522ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:40043 method = POST path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
45692026-03-03T16:56:47.522ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): listening kind = storage local_addr = [::1]:40043 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
45702026-03-03T16:56:47.522ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): successfully registered DTrace USDT probes kind = storage local_addr = [::1]:40043 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
45712026-03-03T16:56:47.522ZINFOtest_metrics (SledAgent): Created Simulated Crucible Server address = [::1]:40043 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
45722026-03-03T16:56:47.522ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = c6cdefa3-25b1-4fa0-b74f-7857b7f57948 serial = totally-unique-serial: c6cdefa3-25b1-4fa0-b74f-7857b7f57948 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
45732026-03-03T16:56:47.522ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45742026-03-03T16:56:47.522ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45752026-03-03T16:56:47.523ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45762026-03-03T16:56:47.523ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7deba189-028a-442b-82dc-0713cdd36d7a", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45772026-03-03T16:56:47.523ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=0
45782026-03-03T16:56:47.524ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "76bb5d67-d11d-465c-abae-b324d3a06fea", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45792026-03-03T16:56:47.524ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=1
45802026-03-03T16:56:47.525ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45812026-03-03T16:56:47.525ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45822026-03-03T16:56:47.525ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45832026-03-03T16:56:47.526ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
45842026-03-03T16:56:47.526ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
45852026-03-03T16:56:47.526ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
45862026-03-03T16:56:47.526ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
45872026-03-03T16:56:47.527ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
45882026-03-03T16:56:47.527ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a36c930a-ca61-4666-923a-4e0ab9a8f194", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45892026-03-03T16:56:47.527ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=0
45902026-03-03T16:56:47.528ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a9b297e-a820-4815-a3b1-2bd83f566a51", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45912026-03-03T16:56:47.528ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=1
45922026-03-03T16:56:47.528ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45932026-03-03T16:56:47.531ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
45942026-03-03T16:56:47.532ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c0aa331-6e7c-4fc5-91ad-5df83d3e1c06", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45952026-03-03T16:56:47.532ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cmpa
45962026-03-03T16:56:47.532ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e649b24f-63f7-4aec-a93a-f4e36bfdea4a", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45972026-03-03T16:56:47.533ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
45982026-03-03T16:56:47.533ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a65a5ac-a4c2-486d-b07e-59661faf9310", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
45992026-03-03T16:56:47.533ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
46002026-03-03T16:56:47.534ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 61.063627ms iteration = 3 status = {"Loaded":{"collection_id":"e8669a74-a33a-40c9-8ae0-615aafa41c7d","time_loaded":"2026-03-03T16:56:47.473226935Z","time_started":"2026-03-03T16:56:47.241842Z"}}
46012026-03-03T16:56:47.534ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
46022026-03-03T16:56:47.534ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.49\u{b5}s iteration = 3 status = {"error":"task disabled"}
46032026-03-03T16:56:47.534ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 3 reason = Dependency
46042026-03-03T16:56:47.534ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
46052026-03-03T16:56:47.534ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
46062026-03-03T16:56:47.534ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
46072026-03-03T16:56:47.534ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 3 reason = Dependency
46082026-03-03T16:56:47.534ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
46092026-03-03T16:56:47.534ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
46102026-03-03T16:56:47.534ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
46112026-03-03T16:56:47.534ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
46122026-03-03T16:56:47.535ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
46132026-03-03T16:56:47.535ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 5 reason = Dependency
46142026-03-03T16:56:47.535ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
46152026-03-03T16:56:47.535ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 18.83\u{b5}s iteration = 5 status = "Disabled"
46162026-03-03T16:56:47.536ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 01 92 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:17707 req_id = 9690debd-fa97-486d-a069-33a8dcdc15c1
46172026-03-03T16:56:47.536ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 402,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:17707 req_id = 9690debd-fa97-486d-a069-33a8dcdc15c1
46182026-03-03T16:56:47.536ZDEBGtest_metrics (store): query key key = _dendrite._tcp
46192026-03-03T16:56:47.536ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
46202026-03-03T16:56:47.536ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:17707 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 9690debd-fa97-486d-a069-33a8dcdc15c1
46212026-03-03T16:56:47.536ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46222026-03-03T16:56:47.539ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
46232026-03-03T16:56:47.539ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
46242026-03-03T16:56:47.539ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
46252026-03-03T16:56:47.539ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
46262026-03-03T16:56:47.539ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
46272026-03-03T16:56:47.540ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
46282026-03-03T16:56:47.540ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1869, tv_nsec: 797316200 } })
46292026-03-03T16:56:47.540ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
46302026-03-03T16:56:47.541ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "aabcf2a5-1e84-4879-9760-286ca58635ba", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46312026-03-03T16:56:47.541ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
46322026-03-03T16:56:47.541ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46332026-03-03T16:56:47.544ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
46342026-03-03T16:56:47.544ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
46352026-03-03T16:56:47.544ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
46362026-03-03T16:56:47.545ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
46372026-03-03T16:56:47.545ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: cf a9 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:47798 req_id = ad3faf08-ab2f-449a-90f5-9b81b314f7f7
46382026-03-03T16:56:47.545ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 53161,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:47798 req_id = ad3faf08-ab2f-449a-90f5-9b81b314f7f7
46392026-03-03T16:56:47.545ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
46402026-03-03T16:56:47.545ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:47798 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = ad3faf08-ab2f-449a-90f5-9b81b314f7f7
46412026-03-03T16:56:47.566ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:42205/switch/identifiers
46422026-03-03T16:56:47.566ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
46432026-03-03T16:56:47.566ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
46442026-03-03T16:56:47.566ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
46452026-03-03T16:56:47.566ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
46462026-03-03T16:56:47.566ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
46472026-03-03T16:56:47.568ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f6e0650-4e83-4302-9410-5db6e55444f4", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46482026-03-03T16:56:47.568ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1
46492026-03-03T16:56:47.568ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:42205/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "45817f71-a9f8-44fc-ba92-8614ec00e9df", "content-length": "206", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46502026-03-03T16:56:47.569ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
46512026-03-03T16:56:47.569ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
46522026-03-03T16:56:47.569ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
46532026-03-03T16:56:47.569ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
46542026-03-03T16:56:47.570ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46552026-03-03T16:56:47.572ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
46562026-03-03T16:56:47.573ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
46572026-03-03T16:56:47.573ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
46582026-03-03T16:56:47.573ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
46592026-03-03T16:56:47.573ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
46602026-03-03T16:56:47.573ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
46612026-03-03T16:56:47.574ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d653946a-20b8-4373-aa09-2b14cfd9cf50", "content-length": "723", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46622026-03-03T16:56:47.575ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/active-slot
46632026-03-03T16:56:47.575ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
46642026-03-03T16:56:47.575ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
46652026-03-03T16:56:47.575ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
46662026-03-03T16:56:47.575ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
46672026-03-03T16:56:47.575ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
46682026-03-03T16:56:47.576ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46692026-03-03T16:56:47.579ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
46702026-03-03T16:56:47.579ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
46712026-03-03T16:56:47.579ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
46722026-03-03T16:56:47.579ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
46732026-03-03T16:56:47.580ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce432ff1-97d7-4c31-a91d-42922326d6f3", "content-length": "10", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46742026-03-03T16:56:47.580ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/0
46752026-03-03T16:56:47.581ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f8f6800-8bb8-4dff-b92b-3dca63f08ad9", "content-length": "144", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46762026-03-03T16:56:47.581ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/1
46772026-03-03T16:56:47.581ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1060ee57-7c54-4727-b0fa-047a2808a919", "content-length": "147", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46782026-03-03T16:56:47.582ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=0
46792026-03-03T16:56:47.582ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "abe8e1ab-12bc-4a23-8c59-04c9d55665be", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46802026-03-03T16:56:47.582ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=1
46812026-03-03T16:56:47.583ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "05274489-8c92-43b6-ba66-50b7eaeb7176", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46822026-03-03T16:56:47.583ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=0
46832026-03-03T16:56:47.584ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5ebfd32-d414-4322-811b-c5e6b990f609", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46842026-03-03T16:56:47.584ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=1
46852026-03-03T16:56:47.585ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd2dd53d-e82f-4c3a-9d04-c00160c422e7", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46862026-03-03T16:56:47.585ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=0
46872026-03-03T16:56:47.585ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8999757-38fc-4214-9b50-04cc438f404e", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
46882026-03-03T16:56:47.585ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=1
46892026-03-03T16:56:47.586ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
46902026-03-03T16:56:47.586ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
46912026-03-03T16:56:47.586ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
46922026-03-03T16:56:47.586ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
46932026-03-03T16:56:47.586ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
46942026-03-03T16:56:47.587ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
46952026-03-03T16:56:47.587ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
46962026-03-03T16:56:47.587ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
46972026-03-03T16:56:47.587ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
46982026-03-03T16:56:47.587ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
46992026-03-03T16:56:47.587ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
47002026-03-03T16:56:47.588ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c2fc03e-8a6b-4342-8cd1-113ed67fb548", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
47012026-03-03T16:56:47.588ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cmpa
47022026-03-03T16:56:47.588ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47032026-03-03T16:56:47.591ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
47042026-03-03T16:56:47.591ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
47052026-03-03T16:56:47.591ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47062026-03-03T16:56:47.591ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
47072026-03-03T16:56:47.591ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
47082026-03-03T16:56:47.592ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
47092026-03-03T16:56:47.593ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa749864-5ffe-47b7-9b41-f2ae47f5b4c6", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
47102026-03-03T16:56:47.593ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
47112026-03-03T16:56:47.593ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47122026-03-03T16:56:47.596ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
47132026-03-03T16:56:47.596ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
47142026-03-03T16:56:47.596ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
47152026-03-03T16:56:47.596ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
47162026-03-03T16:56:47.597ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cde8b52-2ba1-4842-805a-e870327031b1", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
47172026-03-03T16:56:47.597ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
47182026-03-03T16:56:47.598ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d239c36e-61cd-4f98-bd11-b8a5cca11c32", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
47192026-03-03T16:56:47.598ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
47202026-03-03T16:56:47.598ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
47212026-03-03T16:56:47.598ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
47222026-03-03T16:56:47.598ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47232026-03-03T16:56:47.598ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
47242026-03-03T16:56:47.598ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
47252026-03-03T16:56:47.599ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
47262026-03-03T16:56:47.605ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3c2ac90-464d-4cfe-b65a-905faaac8ce0", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
47272026-03-03T16:56:47.605ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
47282026-03-03T16:56:47.605ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47292026-03-03T16:56:47.605ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
47302026-03-03T16:56:47.605ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47312026-03-03T16:56:47.606ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
47322026-03-03T16:56:47.613ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47332026-03-03T16:56:47.616ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
47342026-03-03T16:56:47.616ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
47352026-03-03T16:56:47.616ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47362026-03-03T16:56:47.616ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
47372026-03-03T16:56:47.616ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
47382026-03-03T16:56:47.616ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
47392026-03-03T16:56:47.617ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47402026-03-03T16:56:47.619ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
47412026-03-03T16:56:47.619ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
47422026-03-03T16:56:47.619ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47432026-03-03T16:56:47.619ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
47442026-03-03T16:56:47.619ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47452026-03-03T16:56:47.620ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
47462026-03-03T16:56:47.620ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
47472026-03-03T16:56:47.620ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
47482026-03-03T16:56:47.620ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
47492026-03-03T16:56:47.620ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
47502026-03-03T16:56:47.621ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
47512026-03-03T16:56:47.621ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47522026-03-03T16:56:47.624ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
47532026-03-03T16:56:47.624ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
47542026-03-03T16:56:47.624ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
47552026-03-03T16:56:47.624ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
47562026-03-03T16:56:47.625ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47572026-03-03T16:56:47.627ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
47582026-03-03T16:56:47.627ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
47592026-03-03T16:56:47.627ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47602026-03-03T16:56:47.628ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
47612026-03-03T16:56:47.628ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = c6cdefa3-25b1-4fa0-b74f-7857b7f57948 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = 13c8ab22-383b-47f4-bd3f-b8715d874579
47622026-03-03T16:56:47.628ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
47632026-03-03T16:56:47.628ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
47642026-03-03T16:56:47.629ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
47652026-03-03T16:56:47.629ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
47662026-03-03T16:56:47.629ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 94.87814ms iteration = 3 status = {"blueprint_id":"17e53f87-23ca-4758-8dd3-9566e405f268","inventory_collection_id":"e8669a74-a33a-40c9-8ae0-615aafa41c7d","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
47672026-03-03T16:56:47.629ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
47682026-03-03T16:56:47.629ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
47692026-03-03T16:56:47.629ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
47702026-03-03T16:56:47.629ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
47712026-03-03T16:56:47.630ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
47722026-03-03T16:56:47.639ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:33115
47732026-03-03T16:56:47.639ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:33115 background_task = inventory_collection body = None method = GET uri = http://[::1]:33115/inventory
47742026-03-03T16:56:47.639ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47678 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
47752026-03-03T16:56:47.640ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = GET remote_addr = [::1]:47678 req_id = ad72f57c-390e-4e49-9000-88e6eafc3855 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
47762026-03-03T16:56:47.640ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = GET remote_addr = [::1]:47678 req_id = ad72f57c-390e-4e49-9000-88e6eafc3855 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
47772026-03-03T16:56:47.641ZINFOtest_metrics (dropshot): request completed latency_us = 1130 local_addr = [::1]:33115 method = GET remote_addr = [::1]:47678 req_id = ad72f57c-390e-4e49-9000-88e6eafc3855 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
47782026-03-03T16:56:47.641ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47792026-03-03T16:56:47.643ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
47802026-03-03T16:56:47.643ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:33115 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:33115/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad72f57c-390e-4e49-9000-88e6eafc3855", "content-length": "21353", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
47812026-03-03T16:56:47.645ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
47822026-03-03T16:56:47.645ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
47832026-03-03T16:56:47.645ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
47842026-03-03T16:56:47.645ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
47852026-03-03T16:56:47.645ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
47862026-03-03T16:56:47.645ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
47872026-03-03T16:56:47.654ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 00202f40-5fe9-436d-80ec-5125a4b6d9f1 (omicron_zone)
47882026-03-03T16:56:47.654ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
47892026-03-03T16:56:47.654ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
47902026-03-03T16:56:47.654ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
47912026-03-03T16:56:47.654ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
47922026-03-03T16:56:47.655ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
47932026-03-03T16:56:47.655ZINFOtest_metrics (nexus): upserting Crucible dataset dataset_id = 60e7134a-828d-44bf-b3b9-fed9a76390f3 zpool_id = 13c8ab22-383b-47f4-bd3f-b8715d874579
47942026-03-03T16:56:47.656ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
47952026-03-03T16:56:47.656ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
47962026-03-03T16:56:47.664ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 5af26469-64ce-4f90-bbd5-93c35e3638d1 (omicron_zone)
47972026-03-03T16:56:47.664ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:43957 method = GET uri = http://[::1]:43957/config
47982026-03-03T16:56:47.665ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:43957 remote_addr = [::1]:55846
47992026-03-03T16:56:47.665ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:43957 method = GET remote_addr = [::1]:55846 req_id = 8d21fd79-54ab-49b3-9699-f8f25bbdd9b8 uri = /config
48002026-03-03T16:56:47.665ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:43957 method = GET remote_addr = [::1]:55846 req_id = 8d21fd79-54ab-49b3-9699-f8f25bbdd9b8 uri = /config version = 2.0.0
48012026-03-03T16:56:47.666ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
48022026-03-03T16:56:47.666ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
48032026-03-03T16:56:47.666ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
48042026-03-03T16:56:47.666ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
48052026-03-03T16:56:47.666ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
48062026-03-03T16:56:47.667ZINFOtest_metrics (http): request completed kind = dns latency_us = 1537 local_addr = [::1]:43957 method = GET remote_addr = [::1]:55846 req_id = 8d21fd79-54ab-49b3-9699-f8f25bbdd9b8 response_code = 200 uri = /config
48072026-03-03T16:56:47.667ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:43957 result = Ok(Response { url: "http://[::1]:43957/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d21fd79-54ab-49b3-9699-f8f25bbdd9b8", "content-length": "3478", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
48082026-03-03T16:56:47.667ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 5af26469-64ce-4f90-bbd5-93c35e3638d1 (omicron_zone)
48092026-03-03T16:56:47.667ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
48102026-03-03T16:56:47.667ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
48112026-03-03T16:56:47.668ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
48122026-03-03T16:56:47.668ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48132026-03-03T16:56:47.668ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
48142026-03-03T16:56:47.668ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48152026-03-03T16:56:47.668ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
48162026-03-03T16:56:47.669ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = c6cdefa3-25b1-4fa0-b74f-7857b7f57948 serial = totally-unique-serial: c6cdefa3-25b1-4fa0-b74f-7857b7f57948 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
48172026-03-03T16:56:47.669ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48182026-03-03T16:56:47.669ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48192026-03-03T16:56:47.669ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48202026-03-03T16:56:47.671ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48212026-03-03T16:56:47.674ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
48222026-03-03T16:56:47.674ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
48232026-03-03T16:56:47.674ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48242026-03-03T16:56:47.675ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
48252026-03-03T16:56:47.675ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
48262026-03-03T16:56:47.675ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
48272026-03-03T16:56:47.677ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
48282026-03-03T16:56:47.677ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 142.909277ms iteration = 3 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
48292026-03-03T16:56:47.677ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: c6cdefa3-25b1-4fa0-b74f-7857b7f57948 (physical_disk), lookup_type: ById(c6cdefa3-25b1-4fa0-b74f-7857b7f57948) }
48302026-03-03T16:56:47.677ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48312026-03-03T16:56:47.677ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48322026-03-03T16:56:47.679ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48332026-03-03T16:56:47.679ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48342026-03-03T16:56:47.680ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48352026-03-03T16:56:47.684ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: c6cdefa3-25b1-4fa0-b74f-7857b7f57948 (physical_disk), lookup_type: ById(c6cdefa3-25b1-4fa0-b74f-7857b7f57948) } result = Ok(())
48362026-03-03T16:56:47.684ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = c6cdefa3-25b1-4fa0-b74f-7857b7f57948 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = 13c8ab22-383b-47f4-bd3f-b8715d874579
48372026-03-03T16:56:47.684ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48382026-03-03T16:56:47.684ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48392026-03-03T16:56:47.685ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48402026-03-03T16:56:47.686ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
48412026-03-03T16:56:47.686ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48422026-03-03T16:56:47.686ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48432026-03-03T16:56:47.686ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48442026-03-03T16:56:47.686ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48452026-03-03T16:56:47.689ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48462026-03-03T16:56:47.691ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
48472026-03-03T16:56:47.693ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
48482026-03-03T16:56:47.694ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48492026-03-03T16:56:47.694ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48502026-03-03T16:56:47.694ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48512026-03-03T16:56:47.694ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48522026-03-03T16:56:47.695ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48532026-03-03T16:56:47.697ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
48542026-03-03T16:56:47.697ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48552026-03-03T16:56:47.697ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48562026-03-03T16:56:47.698ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48572026-03-03T16:56:47.704ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
48582026-03-03T16:56:47.705ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48592026-03-03T16:56:47.705ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48602026-03-03T16:56:47.705ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48612026-03-03T16:56:47.705ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48622026-03-03T16:56:47.706ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48632026-03-03T16:56:47.710ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
48642026-03-03T16:56:47.710ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48652026-03-03T16:56:47.710ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48662026-03-03T16:56:47.710ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
48672026-03-03T16:56:47.874ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 2330837b-4e2d-466d-84fd-e0bb3032a5b4
48682026-03-03T16:56:47.874ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 2330837b-4e2d-466d-84fd-e0bb3032a5b4 time_started = 2026-03-03 16:56:47.497559 UTC
48692026-03-03T16:56:47.874ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 402.458009ms iteration = 5 status = {"collection_id":"2330837b-4e2d-466d-84fd-e0bb3032a5b4","time_done":"2026-03-03 16:56:47.667948 UTC","time_started":"2026-03-03 16:56:47.497559 UTC"}
48702026-03-03T16:56:47.874ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 6 reason = Signaled
48712026-03-03T16:56:47.874ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
48722026-03-03T16:56:47.874ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48732026-03-03T16:56:47.874ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
48742026-03-03T16:56:47.874ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48752026-03-03T16:56:47.875ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
48762026-03-03T16:56:47.875ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 4 reason = Dependency
48772026-03-03T16:56:47.875ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
48782026-03-03T16:56:47.875ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48792026-03-03T16:56:47.875ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
48802026-03-03T16:56:47.875ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
48812026-03-03T16:56:47.876ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
48822026-03-03T16:56:47.877ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48832026-03-03T16:56:47.880ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
48842026-03-03T16:56:47.880ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
48852026-03-03T16:56:47.880ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
48862026-03-03T16:56:47.881ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
48872026-03-03T16:56:47.881ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48882026-03-03T16:56:47.885ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
48892026-03-03T16:56:47.885ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
48902026-03-03T16:56:47.885ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
48912026-03-03T16:56:47.886ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
48922026-03-03T16:56:47.891ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
48932026-03-03T16:56:47.891ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
48942026-03-03T16:56:47.892ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
48952026-03-03T16:56:47.892ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(167f54a0-df78-49db-aee7-111ed892ca3f, 2), (e8669a74-a33a-40c9-8ae0-615aafa41c7d, 2), (2330837b-4e2d-466d-84fd-e0bb3032a5b4, 2)]
48962026-03-03T16:56:47.892ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
48972026-03-03T16:56:47.893ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
48982026-03-03T16:56:47.893ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
48992026-03-03T16:56:47.893ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
49002026-03-03T16:56:47.894ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 01 91 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:44730 req_id = 7f06555e-eadb-4f67-993f-6591199c5117
49012026-03-03T16:56:47.894ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 401,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:44730 req_id = 7f06555e-eadb-4f67-993f-6591199c5117
49022026-03-03T16:56:47.894ZDEBGtest_metrics (store): query key key = _mgs._tcp
49032026-03-03T16:56:47.894ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
49042026-03-03T16:56:47.894ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:44730 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 7f06555e-eadb-4f67-993f-6591199c5117
49052026-03-03T16:56:47.895ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1870, tv_nsec: 151715733 } })
49062026-03-03T16:56:47.895ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
49072026-03-03T16:56:47.895ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: b8 ba 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:9852 req_id = 8927a018-6249-46a1-a9f6-cb58a780f1f1
49082026-03-03T16:56:47.895ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 47290,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:9852 req_id = 8927a018-6249-46a1-a9f6-cb58a780f1f1
49092026-03-03T16:56:47.895ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
49102026-03-03T16:56:47.895ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:9852 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 8927a018-6249-46a1-a9f6-cb58a780f1f1
49112026-03-03T16:56:47.904ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
49122026-03-03T16:56:47.905ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 29 32 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c )2..........._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:56532 req_id = 3aad0078-bf83-4361-be0d-d9b5c3bb40f6
49132026-03-03T16:56:47.905ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 10546,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:56532 req_id = 3aad0078-bf83-4361-be0d-d9b5c3bb40f6
49142026-03-03T16:56:47.905ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
49152026-03-03T16:56:47.905ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10546, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:56532 req_id = 3aad0078-bf83-4361-be0d-d9b5c3bb40f6
49162026-03-03T16:56:47.905ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
49172026-03-03T16:56:47.905ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: 4d 81 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f M............_co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:50347 req_id = 793747b1-3414-4b8a-84d1-7fb7392bd717
49182026-03-03T16:56:47.906ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 19841,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:50347 req_id = 793747b1-3414-4b8a-84d1-7fb7392bd717
49192026-03-03T16:56:47.906ZDEBGtest_metrics (store): query key key = _cockroach._tcp
49202026-03-03T16:56:47.906ZDEBGtest_metrics (store): query key key = 5003bd5e-8cef-4ba6-a473-d7948135a715.host
49212026-03-03T16:56:47.906ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:50347 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32943, target: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal") }) }] req_id = 793747b1-3414-4b8a-84d1-7fb7392bd717
49222026-03-03T16:56:47.906ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32943, target: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1870, tv_nsec: 162971161 } })
49232026-03-03T16:56:47.906ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
49242026-03-03T16:56:47.906ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 59 fb 01 00 00 01 00 00 00 00 00 01 24 35 30 30 Y...........$500\n0010: 33 62 64 35 65 2d 38 63 65 66 2d 34 62 61 36 2d 3bd5e-8cef-4ba6-\n0020: 61 34 37 33 2d 64 37 39 34 38 31 33 35 61 37 31 a473-d7948135a71\n0030: 35 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 5.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:27976 req_id = 4a7044f5-7b23-43b1-827d-87a9000ecc4b
49252026-03-03T16:56:47.906ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 23035,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 53,\n 48,\n 48,\n 51,\n 98,\n 100,\n 53,\n 101,\n 45,\n 56,\n 99,\n 101,\n 102,\n 45,\n 52,\n 98,\n 97,\n 54,\n 45,\n 97,\n 52,\n 55,\n 51,\n 45,\n 100,\n 55,\n 57,\n 52,\n 56,\n 49,\n 51,\n 53,\n 97,\n 55,\n 49,\n 53,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:27976 req_id = 4a7044f5-7b23-43b1-827d-87a9000ecc4b
49262026-03-03T16:56:47.907ZDEBGtest_metrics (store): query key key = 5003bd5e-8cef-4ba6-a473-d7948135a715.host
49272026-03-03T16:56:47.907ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:27976 query = LowerQuery { name: LowerName(Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal.")), original: Query { name: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 4a7044f5-7b23-43b1-827d-87a9000ecc4b
49282026-03-03T16:56:47.907ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
49292026-03-03T16:56:47.907ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:36753
49302026-03-03T16:56:47.907ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/ignition
49312026-03-03T16:56:47.909ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "258e76e1-0b24-4e54-9e0b-4e2984004d85", "content-length": "835", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49322026-03-03T16:56:47.909ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0
49332026-03-03T16:56:47.910ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "35984def-2bd7-4215-9be8-b3f62bc39a31", "content-length": "734", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49342026-03-03T16:56:47.910ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=0
49352026-03-03T16:56:47.911ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbd5e69e-398e-41fe-99d3-79aa29dc6a1e", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49362026-03-03T16:56:47.911ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=1
49372026-03-03T16:56:47.912ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "46f58aa8-b658-4435-ab10-5d269b9a929c", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49382026-03-03T16:56:47.912ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=0
49392026-03-03T16:56:47.913ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fe77a0f-cbda-4e18-a664-048926bd6f53", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49402026-03-03T16:56:47.913ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=1
49412026-03-03T16:56:47.914ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "53a0bb18-2511-4fee-a7c7-b15d4ba5e442", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49422026-03-03T16:56:47.914ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=0
49432026-03-03T16:56:47.915ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e30f3ef7-2fdf-4ea4-bcc7-06faf6afdb3d", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49442026-03-03T16:56:47.915ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=1
49452026-03-03T16:56:47.916ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "89dba4dd-5276-452a-beae-68b664d5aa2b", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49462026-03-03T16:56:47.916ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cmpa
49472026-03-03T16:56:47.917ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e33f7b5-e069-48fe-9b9d-7f38e5168154", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49482026-03-03T16:56:47.917ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
49492026-03-03T16:56:47.918ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b121ea8a-216d-4ffd-a738-cdff91659939", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49502026-03-03T16:56:47.918ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
49512026-03-03T16:56:47.919ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "49a7b37a-0341-4b04-9531-70bbeeb4355d", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49522026-03-03T16:56:47.919ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
49532026-03-03T16:56:47.920ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "db5f694f-553d-4a20-be49-1bcd22881b09", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49542026-03-03T16:56:47.920ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1
49552026-03-03T16:56:47.921ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ddabcd8-a42c-4f0d-bd1b-fa406b47467d", "content-length": "734", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49562026-03-03T16:56:47.921ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=0
49572026-03-03T16:56:47.922ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "27f1334c-359b-4347-9234-51200552e8d4", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49582026-03-03T16:56:47.922ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=1
49592026-03-03T16:56:47.923ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a18dd8b-84bd-4142-b4db-429fed2971e4", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49602026-03-03T16:56:47.923ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=0
49612026-03-03T16:56:47.924ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c08a9230-ea5d-4fe8-b1f4-9f19c0a7e10b", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49622026-03-03T16:56:47.924ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=1
49632026-03-03T16:56:47.925ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "45b3762f-9d7a-4287-bb93-fad47b9ba581", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49642026-03-03T16:56:47.925ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=0
49652026-03-03T16:56:47.926ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a125d02-d459-4e75-82c8-b35321345c80", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49662026-03-03T16:56:47.926ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=1
49672026-03-03T16:56:47.930ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "86742c85-e836-433e-bc69-284beeea75e5", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49682026-03-03T16:56:47.930ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cmpa
49692026-03-03T16:56:47.930ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a992834d-78f8-4a01-9c42-4bfc3987b79a", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49702026-03-03T16:56:47.931ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
49712026-03-03T16:56:47.933ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6994a04-bd6a-477f-b46e-0628cc61a40c", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49722026-03-03T16:56:47.933ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
49732026-03-03T16:56:47.934ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
49742026-03-03T16:56:47.935ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:42405 method = GET path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
49752026-03-03T16:56:47.935ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:42405 method = POST path = /crucible/0/regions server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
49762026-03-03T16:56:47.935ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:42405 method = DELETE path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
49772026-03-03T16:56:47.935ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:42405 method = GET path = /crucible/0/regions/{id} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
49782026-03-03T16:56:47.935ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:42405 method = GET path = /crucible/0/regions/{id}/snapshots server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
49792026-03-03T16:56:47.935ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:42405 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
49802026-03-03T16:56:47.935ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:42405 method = GET path = /crucible/0/regions/{id}/snapshots/{name} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
49812026-03-03T16:56:47.935ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:42405 method = DELETE path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
49822026-03-03T16:56:47.935ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): registered endpoint kind = storage local_addr = [::1]:42405 method = POST path = /crucible/0/regions/{id}/snapshots/{name}/run server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
49832026-03-03T16:56:47.935ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): listening kind = storage local_addr = [::1]:42405 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
49842026-03-03T16:56:47.935ZDEBGtest_metrics (Simulated CrucibleAgent Dropshot Server): successfully registered DTrace USDT probes kind = storage local_addr = [::1]:42405 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
49852026-03-03T16:56:47.935ZINFOtest_metrics (SledAgent): Created Simulated Crucible Server address = [::1]:42405 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
49862026-03-03T16:56:47.935ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = c2e88f9c-ea28-4f7a-a1e1-0699c2abceae serial = totally-unique-serial: c2e88f9c-ea28-4f7a-a1e1-0699c2abceae sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
49872026-03-03T16:56:47.935ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
49882026-03-03T16:56:47.935ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
49892026-03-03T16:56:47.936ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
49902026-03-03T16:56:47.939ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d7092da-afe5-4070-890a-98dc299f9e9b", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49912026-03-03T16:56:47.939ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
49922026-03-03T16:56:47.939ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
49932026-03-03T16:56:47.939ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
49942026-03-03T16:56:47.940ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
49952026-03-03T16:56:47.941ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b48a31a-915c-4c0e-a0bf-b5f776fa7c40", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
49962026-03-03T16:56:47.941ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0
49972026-03-03T16:56:47.942ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 66.270555ms iteration = 4 status = {"Loaded":{"collection_id":"2330837b-4e2d-466d-84fd-e0bb3032a5b4","time_loaded":"2026-03-03T16:56:47.875846385Z","time_started":"2026-03-03T16:56:47.497559Z"}}
49982026-03-03T16:56:47.942ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Dependency
49992026-03-03T16:56:47.942ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 26.56\u{b5}s iteration = 4 status = {"error":"task disabled"}
50002026-03-03T16:56:47.942ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 6 reason = Dependency
50012026-03-03T16:56:47.942ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
50022026-03-03T16:56:47.942ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 14.87\u{b5}s iteration = 6 status = "Disabled"
50032026-03-03T16:56:47.942ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 4 reason = Dependency
50042026-03-03T16:56:47.942ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
50052026-03-03T16:56:47.942ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
50062026-03-03T16:56:47.942ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
50072026-03-03T16:56:47.942ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Dependency
50082026-03-03T16:56:47.942ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
50092026-03-03T16:56:47.942ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50102026-03-03T16:56:47.942ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50112026-03-03T16:56:47.942ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50122026-03-03T16:56:47.943ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50132026-03-03T16:56:47.943ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
50142026-03-03T16:56:47.943ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50152026-03-03T16:56:47.944ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
50162026-03-03T16:56:47.944ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
50172026-03-03T16:56:47.944ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
50182026-03-03T16:56:47.945ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50192026-03-03T16:56:47.948ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
50202026-03-03T16:56:47.948ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
50212026-03-03T16:56:47.948ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50222026-03-03T16:56:47.948ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50232026-03-03T16:56:47.948ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50242026-03-03T16:56:47.948ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50252026-03-03T16:56:47.949ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 98 35 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .5..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:30441 req_id = 4e085de2-aaed-4eb7-a0e5-db019741904b
50262026-03-03T16:56:47.951ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 38965,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:30441 req_id = 4e085de2-aaed-4eb7-a0e5-db019741904b
50272026-03-03T16:56:47.951ZDEBGtest_metrics (store): query key key = _dendrite._tcp
50282026-03-03T16:56:47.951ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
50292026-03-03T16:56:47.951ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:30441 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 4e085de2-aaed-4eb7-a0e5-db019741904b
50302026-03-03T16:56:47.951ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50312026-03-03T16:56:47.953ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
50322026-03-03T16:56:47.954ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50332026-03-03T16:56:47.954ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50342026-03-03T16:56:47.954ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50352026-03-03T16:56:47.955ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1870, tv_nsec: 212094749 } })
50362026-03-03T16:56:47.955ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
50372026-03-03T16:56:47.956ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50382026-03-03T16:56:47.959ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
50392026-03-03T16:56:47.962ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
50402026-03-03T16:56:47.962ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50412026-03-03T16:56:47.962ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50422026-03-03T16:56:47.962ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50432026-03-03T16:56:47.962ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50442026-03-03T16:56:47.963ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: da c1 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:8700 req_id = 223adfcb-d834-4e7e-8a67-327b11589e8a
50452026-03-03T16:56:47.963ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56001,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:8700 req_id = 223adfcb-d834-4e7e-8a67-327b11589e8a
50462026-03-03T16:56:47.963ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
50472026-03-03T16:56:47.963ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:8700 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 223adfcb-d834-4e7e-8a67-327b11589e8a
50482026-03-03T16:56:47.982ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:42205/switch/identifiers
50492026-03-03T16:56:47.982ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "da05384e-92fa-43d9-a546-9f5dbd63c2de", "content-length": "723", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
50502026-03-03T16:56:47.983ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/active-slot
50512026-03-03T16:56:47.984ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:42205/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6de761a-aa17-49bc-8252-db5052361183", "content-length": "206", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
50522026-03-03T16:56:47.984ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
50532026-03-03T16:56:47.984ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
50542026-03-03T16:56:47.984ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
50552026-03-03T16:56:47.985ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
50562026-03-03T16:56:47.985ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50572026-03-03T16:56:47.988ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
50582026-03-03T16:56:47.988ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
50592026-03-03T16:56:47.988ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50602026-03-03T16:56:47.988ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50612026-03-03T16:56:47.988ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50622026-03-03T16:56:47.989ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50632026-03-03T16:56:47.990ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "d19423d0-17e8-4cc1-b86b-a323392083e4", "content-length": "10", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
50642026-03-03T16:56:47.990ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/0
50652026-03-03T16:56:47.990ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f118d75f-0cc6-4cd6-be58-233095406cae", "content-length": "144", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
50662026-03-03T16:56:47.991ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/1
50672026-03-03T16:56:47.991ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "982f5bbb-4e4d-4a11-afb8-8e40607f0dd5", "content-length": "147", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
50682026-03-03T16:56:47.991ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=0
50692026-03-03T16:56:47.992ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50702026-03-03T16:56:47.995ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
50712026-03-03T16:56:47.995ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50722026-03-03T16:56:47.995ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50732026-03-03T16:56:47.995ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50742026-03-03T16:56:47.996ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
50752026-03-03T16:56:47.996ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
50762026-03-03T16:56:47.996ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
50772026-03-03T16:56:47.996ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
50782026-03-03T16:56:47.996ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
50792026-03-03T16:56:47.997ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f076340e-abbd-49b1-9c97-1467afd96142", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:47 GMT"} })
50802026-03-03T16:56:47.997ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=1
50812026-03-03T16:56:47.998ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
50822026-03-03T16:56:47.998ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
50832026-03-03T16:56:47.998ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50842026-03-03T16:56:47.998ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
50852026-03-03T16:56:47.998ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50862026-03-03T16:56:47.998ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50872026-03-03T16:56:47.999ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
50882026-03-03T16:56:47.999ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
50892026-03-03T16:56:47.999ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
50902026-03-03T16:56:47.999ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
50912026-03-03T16:56:47.999ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
50922026-03-03T16:56:48.000ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "33f9ca45-664b-459a-a9b9-6a1b1dfbc85c", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
50932026-03-03T16:56:48.000ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=0
50942026-03-03T16:56:48.001ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a075f806-2b89-4fe0-8706-4a77ad4a2458", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
50952026-03-03T16:56:48.001ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=1
50962026-03-03T16:56:48.001ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50972026-03-03T16:56:48.004ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
50982026-03-03T16:56:48.004ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
50992026-03-03T16:56:48.004ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51002026-03-03T16:56:48.004ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
51012026-03-03T16:56:48.004ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51022026-03-03T16:56:48.004ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51032026-03-03T16:56:48.005ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "51bc4238-36d4-46db-9b0c-0d35353095eb", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51042026-03-03T16:56:48.006ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=0
51052026-03-03T16:56:48.006ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fb7b7aa-71db-477d-b69a-84a87c7b72c9", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51062026-03-03T16:56:48.006ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=1
51072026-03-03T16:56:48.007ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a06a6803-aa53-4505-9b6b-fc60a9e1f888", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51082026-03-03T16:56:48.007ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cmpa
51092026-03-03T16:56:48.007ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51102026-03-03T16:56:48.012ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
51112026-03-03T16:56:48.012ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
51122026-03-03T16:56:48.012ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51132026-03-03T16:56:48.012ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51142026-03-03T16:56:48.013ZDEBGtest_metrics (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 2 reason = Timeout
51152026-03-03T16:56:48.013ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig
51162026-03-03T16:56:48.013ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = reconfigurator_config_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51172026-03-03T16:56:48.013ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
51182026-03-03T16:56:48.013ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
51192026-03-03T16:56:48.013ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
51202026-03-03T16:56:48.014ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0950a517-84cd-49c5-addd-8b1d22a49385", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51212026-03-03T16:56:48.014ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
51222026-03-03T16:56:48.015ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
51232026-03-03T16:56:48.015ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
51242026-03-03T16:56:48.015ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51252026-03-03T16:56:48.015ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
51262026-03-03T16:56:48.015ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51272026-03-03T16:56:48.015ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51282026-03-03T16:56:48.016ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51292026-03-03T16:56:48.020ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
51302026-03-03T16:56:48.020ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
51312026-03-03T16:56:48.020ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
51322026-03-03T16:56:48.020ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
51332026-03-03T16:56:48.021ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "065c319b-6471-4875-8703-3bf1e37d0d70", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51342026-03-03T16:56:48.021ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
51352026-03-03T16:56:48.021ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51362026-03-03T16:56:48.024ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
51372026-03-03T16:56:48.024ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
51382026-03-03T16:56:48.024ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51392026-03-03T16:56:48.024ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
51402026-03-03T16:56:48.024ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51412026-03-03T16:56:48.024ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51422026-03-03T16:56:48.026ZDEBGtest_metrics (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: false, planner_config: PlannerConfig { add_zones_with_mupdate_override: false }, tuf_repo_pruner_enabled: true }, time_modified: 2026-03-03T16:56:42.943994Z })
51432026-03-03T16:56:48.026ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 13.664992ms iteration = 2 status = {"config_updated":false}
51442026-03-03T16:56:48.027ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5cad277-4582-4722-a5c1-d0c052fb32bd", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51452026-03-03T16:56:48.028ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
51462026-03-03T16:56:48.028ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51472026-03-03T16:56:48.030ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
51482026-03-03T16:56:48.031ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
51492026-03-03T16:56:48.031ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51502026-03-03T16:56:48.031ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51512026-03-03T16:56:48.034ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
51522026-03-03T16:56:48.034ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 92.262266ms iteration = 4 status = {"blueprint_id":"17e53f87-23ca-4758-8dd3-9566e405f268","inventory_collection_id":"2330837b-4e2d-466d-84fd-e0bb3032a5b4","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
51532026-03-03T16:56:48.034ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = c2e88f9c-ea28-4f7a-a1e1-0699c2abceae sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = ddebdaea-c7a6-4a30-8bce-3ef11a4be74f
51542026-03-03T16:56:48.035ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
51552026-03-03T16:56:48.035ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
51562026-03-03T16:56:48.035ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
51572026-03-03T16:56:48.036ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcf5405d-6b31-4396-8694-b040f230061c", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51582026-03-03T16:56:48.036ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1
51592026-03-03T16:56:48.038ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
51602026-03-03T16:56:48.038ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51612026-03-03T16:56:48.038ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
51622026-03-03T16:56:48.038ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
51632026-03-03T16:56:48.038ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
51642026-03-03T16:56:48.038ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
51652026-03-03T16:56:48.038ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
51662026-03-03T16:56:48.038ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
51672026-03-03T16:56:48.038ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
51682026-03-03T16:56:48.039ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
51692026-03-03T16:56:48.042ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
51702026-03-03T16:56:48.042ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
51712026-03-03T16:56:48.042ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
51722026-03-03T16:56:48.042ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
51732026-03-03T16:56:48.043ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51742026-03-03T16:56:48.044ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
51752026-03-03T16:56:48.046ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9177a17e-345f-47ed-88ea-61acb826de72", "content-length": "723", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51762026-03-03T16:56:48.046ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/active-slot
51772026-03-03T16:56:48.051ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "3690f692-d833-4f9f-b7f6-230fba7b95f6", "content-length": "10", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51782026-03-03T16:56:48.051ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/0
51792026-03-03T16:56:48.053ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5852c126-e5c8-42ee-baeb-4313196f434d", "content-length": "144", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51802026-03-03T16:56:48.053ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/1
51812026-03-03T16:56:48.054ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bba1424-08d3-4a0b-bf3d-392e37532559", "content-length": "147", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51822026-03-03T16:56:48.054ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=0
51832026-03-03T16:56:48.054ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "148a9613-85c1-4692-937f-9f32722b4ee6", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51842026-03-03T16:56:48.054ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=1
51852026-03-03T16:56:48.055ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "65167d39-406a-4747-b083-36e15d023141", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51862026-03-03T16:56:48.055ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=0
51872026-03-03T16:56:48.055ZINFOtest_metrics (nexus): upserting Crucible dataset dataset_id = d3c33217-f619-4e69-b6d2-811716714c70 zpool_id = ddebdaea-c7a6-4a30-8bce-3ef11a4be74f
51882026-03-03T16:56:48.056ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3970475-c454-4c56-b0ed-1df4db01e90a", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51892026-03-03T16:56:48.056ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=1
51902026-03-03T16:56:48.057ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7f37ed7-5dec-4b1a-9369-04420085b91c", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51912026-03-03T16:56:48.057ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=0
51922026-03-03T16:56:48.058ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "65a29b58-3fd6-440a-aa76-0f731cacc97f", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51932026-03-03T16:56:48.058ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=1
51942026-03-03T16:56:48.059ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a57b31fa-c4b6-4c19-82ad-2e63ff2cec53", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51952026-03-03T16:56:48.059ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cmpa
51962026-03-03T16:56:48.059ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c939c63-3ddd-4aed-b1dd-745b4ba609e8", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51972026-03-03T16:56:48.059ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
51982026-03-03T16:56:48.060ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e80ef12c-e980-4c7b-82f3-4478bb977d97", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
51992026-03-03T16:56:48.060ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
52002026-03-03T16:56:48.060ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "80120904-d775-4c98-8fde-ac7e52f48114", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
52012026-03-03T16:56:48.060ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
52022026-03-03T16:56:48.061ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a11fc482-5ad3-430c-afbd-b18075681c8e", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
52032026-03-03T16:56:48.062ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
52042026-03-03T16:56:48.062ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52052026-03-03T16:56:48.062ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
52062026-03-03T16:56:48.062ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52072026-03-03T16:56:48.062ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
52082026-03-03T16:56:48.063ZINFOtest_metrics (nexus): inserting test physical disk model = test-model physical_disk_id = c2e88f9c-ea28-4f7a-a1e1-0699c2abceae serial = totally-unique-serial: c2e88f9c-ea28-4f7a-a1e1-0699c2abceae sled_id = b6d65341-167c-41df-9b5c-41cded99c229 vendor = test-vendor
52092026-03-03T16:56:48.064ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52102026-03-03T16:56:48.064ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52112026-03-03T16:56:48.064ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52122026-03-03T16:56:48.064ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52132026-03-03T16:56:48.067ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
52142026-03-03T16:56:48.067ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
52152026-03-03T16:56:48.067ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52162026-03-03T16:56:48.067ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
52172026-03-03T16:56:48.067ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52182026-03-03T16:56:48.068ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
52192026-03-03T16:56:48.068ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: c2e88f9c-ea28-4f7a-a1e1-0699c2abceae (physical_disk), lookup_type: ById(c2e88f9c-ea28-4f7a-a1e1-0699c2abceae) }
52202026-03-03T16:56:48.068ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52212026-03-03T16:56:48.068ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52222026-03-03T16:56:48.068ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52232026-03-03T16:56:48.069ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52242026-03-03T16:56:48.078ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52252026-03-03T16:56:48.078ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = PhysicalDisk { parent: Fleet, key: c2e88f9c-ea28-4f7a-a1e1-0699c2abceae (physical_disk), lookup_type: ById(c2e88f9c-ea28-4f7a-a1e1-0699c2abceae) } result = Ok(())
52262026-03-03T16:56:48.078ZINFOtest_metrics (nexus): upserting zpool physical_disk_id = c2e88f9c-ea28-4f7a-a1e1-0699c2abceae sled_id = b6d65341-167c-41df-9b5c-41cded99c229 zpool_id = ddebdaea-c7a6-4a30-8bce-3ef11a4be74f
52272026-03-03T16:56:48.078ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52282026-03-03T16:56:48.078ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52292026-03-03T16:56:48.078ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52302026-03-03T16:56:48.078ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52312026-03-03T16:56:48.079ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
52322026-03-03T16:56:48.080ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
52332026-03-03T16:56:48.080ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52342026-03-03T16:56:48.080ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
52352026-03-03T16:56:48.081ZTRACtest_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
52362026-03-03T16:56:48.081ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52372026-03-03T16:56:48.081ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52382026-03-03T16:56:48.081ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52392026-03-03T16:56:48.081ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52402026-03-03T16:56:48.082ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52412026-03-03T16:56:48.090ZDEBGtest_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
52422026-03-03T16:56:48.100ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:33115
52432026-03-03T16:56:48.100ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:33115 background_task = inventory_collection body = None method = GET uri = http://[::1]:33115/inventory
52442026-03-03T16:56:48.100ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
52452026-03-03T16:56:48.100ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
52462026-03-03T16:56:48.100ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
52472026-03-03T16:56:48.100ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
52482026-03-03T16:56:48.102ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
52492026-03-03T16:56:48.102ZTRACtest_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
52502026-03-03T16:56:48.102ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52512026-03-03T16:56:48.102ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52522026-03-03T16:56:48.102ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52532026-03-03T16:56:48.102ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52542026-03-03T16:56:48.103ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47680 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
52552026-03-03T16:56:48.108ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = GET remote_addr = [::1]:47680 req_id = c8eb24c6-7350-434e-b8f0-0c44efd9bfa2 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
52562026-03-03T16:56:48.108ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = GET remote_addr = [::1]:47680 req_id = c8eb24c6-7350-434e-b8f0-0c44efd9bfa2 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
52572026-03-03T16:56:48.108ZINFOtest_metrics (dropshot): request completed latency_us = 1190 local_addr = [::1]:33115 method = GET remote_addr = [::1]:47680 req_id = c8eb24c6-7350-434e-b8f0-0c44efd9bfa2 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
52582026-03-03T16:56:48.108ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
52592026-03-03T16:56:48.108ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
52602026-03-03T16:56:48.108ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
52612026-03-03T16:56:48.108ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 164.390961ms iteration = 4 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
52622026-03-03T16:56:48.108ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:33115 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:33115/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8eb24c6-7350-434e-b8f0-0c44efd9bfa2", "content-length": "21727", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
52632026-03-03T16:56:48.110ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
52642026-03-03T16:56:48.110ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
52652026-03-03T16:56:48.110ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
52662026-03-03T16:56:48.110ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
52672026-03-03T16:56:48.110ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52682026-03-03T16:56:48.113ZDEBGtest_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
52692026-03-03T16:56:48.113ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52702026-03-03T16:56:48.113ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52712026-03-03T16:56:48.113ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52722026-03-03T16:56:48.114ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
52732026-03-03T16:56:48.114ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
52742026-03-03T16:56:48.123ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 00202f40-5fe9-436d-80ec-5125a4b6d9f1 (omicron_zone)
52752026-03-03T16:56:48.123ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
52762026-03-03T16:56:48.123ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
52772026-03-03T16:56:48.123ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
52782026-03-03T16:56:48.132ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 5af26469-64ce-4f90-bbd5-93c35e3638d1 (omicron_zone)
52792026-03-03T16:56:48.132ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:43957 method = GET uri = http://[::1]:43957/config
52802026-03-03T16:56:48.132ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:43957 remote_addr = [::1]:55848
52812026-03-03T16:56:48.133ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:43957 method = GET remote_addr = [::1]:55848 req_id = 0814198b-1665-4313-9d8c-86f2bbf09e68 uri = /config
52822026-03-03T16:56:48.133ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:43957 method = GET remote_addr = [::1]:55848 req_id = 0814198b-1665-4313-9d8c-86f2bbf09e68 uri = /config version = 2.0.0
52832026-03-03T16:56:48.133ZINFOtest_metrics (http): request completed kind = dns latency_us = 594 local_addr = [::1]:43957 method = GET remote_addr = [::1]:55848 req_id = 0814198b-1665-4313-9d8c-86f2bbf09e68 response_code = 200 uri = /config
52842026-03-03T16:56:48.134ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:43957 result = Ok(Response { url: "http://[::1]:43957/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0814198b-1665-4313-9d8c-86f2bbf09e68", "content-length": "3478", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
52852026-03-03T16:56:48.134ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 5af26469-64ce-4f90-bbd5-93c35e3638d1 (omicron_zone)
52862026-03-03T16:56:48.134ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
52872026-03-03T16:56:48.134ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
52882026-03-03T16:56:48.134ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
52892026-03-03T16:56:48.134ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52902026-03-03T16:56:48.134ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
52912026-03-03T16:56:48.134ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52922026-03-03T16:56:48.135ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
52932026-03-03T16:56:48.141ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
52942026-03-03T16:56:48.141ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52952026-03-03T16:56:48.141ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
52962026-03-03T16:56:48.141ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
52972026-03-03T16:56:48.142ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
52982026-03-03T16:56:48.143ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52992026-03-03T16:56:48.146ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
53002026-03-03T16:56:48.147ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
53012026-03-03T16:56:48.147ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53022026-03-03T16:56:48.148ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
53032026-03-03T16:56:48.162ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53042026-03-03T16:56:48.167ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
53052026-03-03T16:56:48.167ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
53062026-03-03T16:56:48.167ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
53072026-03-03T16:56:48.167ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
53082026-03-03T16:56:48.172ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
53092026-03-03T16:56:48.172ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
53102026-03-03T16:56:48.173ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
53112026-03-03T16:56:48.206ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
53122026-03-03T16:56:48.257ZTRACtest_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory
53132026-03-03T16:56:48.258ZTRACtest_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53142026-03-03T16:56:48.258ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
53152026-03-03T16:56:48.258ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
53162026-03-03T16:56:48.258ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
53172026-03-03T16:56:48.260ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53182026-03-03T16:56:48.264ZDEBGtest_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Inventory result = Ok(())
53192026-03-03T16:56:48.264ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
53202026-03-03T16:56:48.264ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
53212026-03-03T16:56:48.264ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
53222026-03-03T16:56:48.331ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 1676add0-b86f-4425-8460-eb4c84941409
53232026-03-03T16:56:48.331ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 1676add0-b86f-4425-8460-eb4c84941409 time_started = 2026-03-03 16:56:47.907387 UTC
53242026-03-03T16:56:48.332ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 456.780876ms iteration = 6 status = {"collection_id":"1676add0-b86f-4425-8460-eb4c84941409","time_done":"2026-03-03 16:56:48.134567 UTC","time_started":"2026-03-03 16:56:47.907387 UTC"}
53252026-03-03T16:56:48.332ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 7 reason = Signaled
53262026-03-03T16:56:48.332ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
53272026-03-03T16:56:48.332ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53282026-03-03T16:56:48.332ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
53292026-03-03T16:56:48.332ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53302026-03-03T16:56:48.332ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
53312026-03-03T16:56:48.332ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 5 reason = Dependency
53322026-03-03T16:56:48.332ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
53332026-03-03T16:56:48.332ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53342026-03-03T16:56:48.332ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
53352026-03-03T16:56:48.332ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
53362026-03-03T16:56:48.333ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
53372026-03-03T16:56:48.334ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53382026-03-03T16:56:48.337ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
53392026-03-03T16:56:48.337ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
53402026-03-03T16:56:48.338ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53412026-03-03T16:56:48.338ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
53422026-03-03T16:56:48.338ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53432026-03-03T16:56:48.342ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
53442026-03-03T16:56:48.342ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
53452026-03-03T16:56:48.342ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
53462026-03-03T16:56:48.343ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
53472026-03-03T16:56:48.346ZTRACtest_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
53482026-03-03T16:56:48.346ZDEBGtest_metrics (InternalApi): roles roles = RoleSet { roles: {} }
53492026-03-03T16:56:48.347ZDEBGtest_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
53502026-03-03T16:56:48.347ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
53512026-03-03T16:56:48.347ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
53522026-03-03T16:56:48.348ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
53532026-03-03T16:56:48.348ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(167f54a0-df78-49db-aee7-111ed892ca3f, 2), (e8669a74-a33a-40c9-8ae0-615aafa41c7d, 2), (2330837b-4e2d-466d-84fd-e0bb3032a5b4, 2), (1676add0-b86f-4425-8460-eb4c84941409, 2)] collection_id = 167f54a0-df78-49db-aee7-111ed892ca3f
53542026-03-03T16:56:48.348ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
53552026-03-03T16:56:48.348ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53562026-03-03T16:56:48.348ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
53572026-03-03T16:56:48.394ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 61.497328ms iteration = 5 status = {"Loaded":{"collection_id":"1676add0-b86f-4425-8460-eb4c84941409","time_loaded":"2026-03-03T16:56:48.332800350Z","time_started":"2026-03-03T16:56:47.907387Z"}}
53582026-03-03T16:56:48.394ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Dependency
53592026-03-03T16:56:48.394ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 28.56\u{b5}s iteration = 5 status = {"error":"task disabled"}
53602026-03-03T16:56:48.394ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Dependency
53612026-03-03T16:56:48.394ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
53622026-03-03T16:56:48.394ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53632026-03-03T16:56:48.394ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
53642026-03-03T16:56:48.394ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53652026-03-03T16:56:48.395ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53662026-03-03T16:56:48.395ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 7 reason = Dependency
53672026-03-03T16:56:48.395ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
53682026-03-03T16:56:48.395ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 24.5\u{b5}s iteration = 7 status = "Disabled"
53692026-03-03T16:56:48.395ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 5 reason = Dependency
53702026-03-03T16:56:48.395ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
53712026-03-03T16:56:48.395ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
53722026-03-03T16:56:48.395ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
53732026-03-03T16:56:48.396ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 82 18 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:63145 req_id = 6ff1b7dd-7e10-4d8c-9ec8-c8c5c1f8a0e7
53742026-03-03T16:56:48.396ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 33304,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:63145 req_id = 6ff1b7dd-7e10-4d8c-9ec8-c8c5c1f8a0e7
53752026-03-03T16:56:48.396ZDEBGtest_metrics (store): query key key = _dendrite._tcp
53762026-03-03T16:56:48.396ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
53772026-03-03T16:56:48.396ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:63145 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 6ff1b7dd-7e10-4d8c-9ec8-c8c5c1f8a0e7
53782026-03-03T16:56:48.397ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1870, tv_nsec: 653812411 } })
53792026-03-03T16:56:48.397ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
53802026-03-03T16:56:48.399ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53812026-03-03T16:56:48.402ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
53822026-03-03T16:56:48.402ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
53832026-03-03T16:56:48.402ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53842026-03-03T16:56:48.402ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
53852026-03-03T16:56:48.402ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53862026-03-03T16:56:48.403ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53872026-03-03T16:56:48.404ZDEBGtest_metrics: attempt to fetch latest inventory collection result = Ok("found")
53882026-03-03T16:56:48.404ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: ce 34 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .4..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:56200 req_id = 8d658a63-528d-4499-8a34-b49a2f5d49ec
53892026-03-03T16:56:48.404ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 52788,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:56200 req_id = 8d658a63-528d-4499-8a34-b49a2f5d49ec
53902026-03-03T16:56:48.404ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
53912026-03-03T16:56:48.405ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:56200 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 8d658a63-528d-4499-8a34-b49a2f5d49ec
53922026-03-03T16:56:48.423ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:42205/switch/identifiers
53932026-03-03T16:56:48.423ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942026-03-03T16:56:48.427ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
53952026-03-03T16:56:48.427ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
53962026-03-03T16:56:48.427ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53972026-03-03T16:56:48.427ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53982026-03-03T16:56:48.428ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:42205/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "619834a5-46ea-47e3-b39f-3d2297099069", "content-length": "206", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
53992026-03-03T16:56:48.428ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
54002026-03-03T16:56:48.428ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
54012026-03-03T16:56:48.428ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
54022026-03-03T16:56:48.429ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
54032026-03-03T16:56:48.430ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
54042026-03-03T16:56:48.430ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54052026-03-03T16:56:48.430ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54062026-03-03T16:56:48.430ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54072026-03-03T16:56:48.431ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54082026-03-03T16:56:48.431ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
54092026-03-03T16:56:48.431ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
54102026-03-03T16:56:48.431ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
54112026-03-03T16:56:48.431ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
54122026-03-03T16:56:48.432ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
54132026-03-03T16:56:48.433ZINFOtest_metrics (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 167f54a0-df78-49db-aee7-111ed892ca3f nboot_partitions = 2 ncabooses = 24 nclickhouse_keeper_membership = 0 ncockroach_status = 0 ncollections = 1 nconfig_reconcilers = 1 ndatasets = 7 nerrors = 2 nhost_phase1_active_slots = 2 nhost_phase1_flash_hashes = 4 ninternal_dns = 1 nlast_reconciliation_dataset_results = 7 nlast_reconciliation_disk_results = 10 nlast_reconciliation_measurements = 2 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 7 nmeasurement_manifest_non_boot = 0 nmupdate_override_non_boot = 0 nntp_timesync = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 7 nomicron_sled_config_disks = 10 nomicron_sled_config_zone_nics = 3 nomicron_sled_config_zones = 7 nomicron_sled_configs = 1 nphysical_disks = 0 nrot_pages = 16 nrots = 4 nsled_agents = 1 nsps = 4 nzone_manifest_measurements = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
54142026-03-03T16:56:48.433ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
54152026-03-03T16:56:48.433ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
54162026-03-03T16:56:48.434ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
54172026-03-03T16:56:48.434ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54182026-03-03T16:56:48.437ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54192026-03-03T16:56:48.437ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
54202026-03-03T16:56:48.437ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54212026-03-03T16:56:48.437ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54222026-03-03T16:56:48.437ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54232026-03-03T16:56:48.437ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54242026-03-03T16:56:48.437ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
54252026-03-03T16:56:48.437ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
54262026-03-03T16:56:48.437ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
54272026-03-03T16:56:48.437ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
54282026-03-03T16:56:48.438ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
54292026-03-03T16:56:48.439ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54302026-03-03T16:56:48.442ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54312026-03-03T16:56:48.442ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54322026-03-03T16:56:48.442ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54332026-03-03T16:56:48.446ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54342026-03-03T16:56:48.446ZDEBGtest_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(e8669a74-a33a-40c9-8ae0-615aafa41c7d, 2), (2330837b-4e2d-466d-84fd-e0bb3032a5b4, 2), (1676add0-b86f-4425-8460-eb4c84941409, 2)]
54352026-03-03T16:56:48.446ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
54362026-03-03T16:56:48.446ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 79 dd 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 y............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:47627 req_id = 61d6494a-92d7-42cd-900a-b3ec92c67e9e
54372026-03-03T16:56:48.446ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 31197,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:47627 req_id = 61d6494a-92d7-42cd-900a-b3ec92c67e9e
54382026-03-03T16:56:48.446ZDEBGtest_metrics (store): query key key = _mgs._tcp
54392026-03-03T16:56:48.446ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
54402026-03-03T16:56:48.446ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:47627 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 61d6494a-92d7-42cd-900a-b3ec92c67e9e
54412026-03-03T16:56:48.446ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1870, tv_nsec: 700453425 } })
54422026-03-03T16:56:48.447ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
54432026-03-03T16:56:48.447ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: bd ce 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:2696 req_id = 1628f1b6-74b0-44db-ab54-927552cd8559
54442026-03-03T16:56:48.447ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 48590,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:2696 req_id = 1628f1b6-74b0-44db-ab54-927552cd8559
54452026-03-03T16:56:48.447ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
54462026-03-03T16:56:48.447ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:2696 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 1628f1b6-74b0-44db-ab54-927552cd8559
54472026-03-03T16:56:48.453ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
54482026-03-03T16:56:48.453ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
54492026-03-03T16:56:48.453ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
54502026-03-03T16:56:48.453ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54512026-03-03T16:56:48.453ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54522026-03-03T16:56:48.453ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54532026-03-03T16:56:48.454ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54542026-03-03T16:56:48.454ZTRACtest_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 50 89 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c P............_cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:34395 req_id = a74bbe17-d4d8-4d4c-a76c-6955e99dde9d
54552026-03-03T16:56:48.454ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 20617,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:34395 req_id = a74bbe17-d4d8-4d4c-a76c-6955e99dde9d
54562026-03-03T16:56:48.454ZDEBGtest_metrics (store): query key key = _clickhouse-admin-keeper._tcp
54572026-03-03T16:56:48.455ZERROtest_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 20617, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:34395 req_id = a74bbe17-d4d8-4d4c-a76c-6955e99dde9d
54582026-03-03T16:56:48.455ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
54592026-03-03T16:56:48.455ZTRACtest_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: e5 64 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f .d..........._co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:49240 req_id = 8a871b7d-0381-4bab-a44b-0cbe67d5cc76
54602026-03-03T16:56:48.455ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 58724,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:49240 req_id = 8a871b7d-0381-4bab-a44b-0cbe67d5cc76
54612026-03-03T16:56:48.455ZDEBGtest_metrics (store): query key key = _cockroach._tcp
54622026-03-03T16:56:48.455ZDEBGtest_metrics (store): query key key = 5003bd5e-8cef-4ba6-a473-d7948135a715.host
54632026-03-03T16:56:48.455ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:49240 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32943, target: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal") }) }] req_id = 8a871b7d-0381-4bab-a44b-0cbe67d5cc76
54642026-03-03T16:56:48.455ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54652026-03-03T16:56:48.458ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54662026-03-03T16:56:48.458ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
54672026-03-03T16:56:48.458ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54682026-03-03T16:56:48.458ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54692026-03-03T16:56:48.458ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54702026-03-03T16:56:48.459ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54712026-03-03T16:56:48.459ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32943, target: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1870, tv_nsec: 716235820 } })
54722026-03-03T16:56:48.459ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
54732026-03-03T16:56:48.460ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 14 bd 01 00 00 01 00 00 00 00 00 01 24 35 30 30 ............$500\n0010: 33 62 64 35 65 2d 38 63 65 66 2d 34 62 61 36 2d 3bd5e-8cef-4ba6-\n0020: 61 34 37 33 2d 64 37 39 34 38 31 33 35 61 37 31 a473-d7948135a71\n0030: 35 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 5.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:59775 req_id = 2dedf869-38d4-4eaf-88a6-a0f47a1d9dad
54742026-03-03T16:56:48.460ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 5309,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 53,\n 48,\n 48,\n 51,\n 98,\n 100,\n 53,\n 101,\n 45,\n 56,\n 99,\n 101,\n 102,\n 45,\n 52,\n 98,\n 97,\n 54,\n 45,\n 97,\n 52,\n 55,\n 51,\n 45,\n 100,\n 55,\n 57,\n 52,\n 56,\n 49,\n 51,\n 53,\n 97,\n 55,\n 49,\n 53,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:59775 req_id = 2dedf869-38d4-4eaf-88a6-a0f47a1d9dad
54752026-03-03T16:56:48.460ZDEBGtest_metrics (store): query key key = 5003bd5e-8cef-4ba6-a473-d7948135a715.host
54762026-03-03T16:56:48.460ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:59775 query = LowerQuery { name: LowerName(Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal.")), original: Query { name: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("5003bd5e-8cef-4ba6-a473-d7948135a715.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 2dedf869-38d4-4eaf-88a6-a0f47a1d9dad
54772026-03-03T16:56:48.460ZDEBGtest_metrics (BackgroundTasks): begin collection background_task = inventory_collection
54782026-03-03T16:56:48.460ZDEBGtest_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:36753
54792026-03-03T16:56:48.460ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/ignition
54802026-03-03T16:56:48.460ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54812026-03-03T16:56:48.464ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
54822026-03-03T16:56:48.464ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
54832026-03-03T16:56:48.464ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54842026-03-03T16:56:48.464ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54852026-03-03T16:56:48.466ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0ffe578-dc6e-4c7f-8043-aed79e071c28", "content-length": "835", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
54862026-03-03T16:56:48.466ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0
54872026-03-03T16:56:48.467ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "28c60218-5bef-45a8-8863-901e8f5efe0b", "content-length": "734", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
54882026-03-03T16:56:48.467ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=0
54892026-03-03T16:56:48.468ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e129058-a3ca-43a3-9b98-7e94399130f6", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
54902026-03-03T16:56:48.468ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=1
54912026-03-03T16:56:48.469ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cf1711a-8691-4706-a25c-d6516ef818f5", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
54922026-03-03T16:56:48.469ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=0
54932026-03-03T16:56:48.470ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3db20634-080f-4466-b807-674f89f6c22c", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
54942026-03-03T16:56:48.470ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=1
54952026-03-03T16:56:48.470ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "06f40370-b25a-490e-b709-b658e24e0f39", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
54962026-03-03T16:56:48.471ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=0
54972026-03-03T16:56:48.471ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c9d1086-bfa4-4660-ab1a-9755e29632cf", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
54982026-03-03T16:56:48.471ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=1
54992026-03-03T16:56:48.472ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "91cd5ef1-3c7f-40fc-a974-993077b9bc25", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55002026-03-03T16:56:48.472ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cmpa
55012026-03-03T16:56:48.473ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "82db1f6b-3bf8-4a70-a85d-a53980812a8e", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55022026-03-03T16:56:48.473ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
55032026-03-03T16:56:48.474ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d90f6e0-889e-459c-ac76-70292e82ca9f", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55042026-03-03T16:56:48.474ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
55052026-03-03T16:56:48.474ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "739c64e7-f0a8-4ac5-99b3-ff61a0eb3df5", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55062026-03-03T16:56:48.474ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/0/component/rot/cfpa
55072026-03-03T16:56:48.477ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e6cc333-2069-4f74-87e1-ee8504aae637", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55082026-03-03T16:56:48.477ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1
55092026-03-03T16:56:48.477ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "07e959b5-e4a1-484e-8ffa-0a8adba0d3a6", "content-length": "734", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55102026-03-03T16:56:48.477ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=0
55112026-03-03T16:56:48.477ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
55122026-03-03T16:56:48.477ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
55132026-03-03T16:56:48.477ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
55142026-03-03T16:56:48.477ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
55152026-03-03T16:56:48.477ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55162026-03-03T16:56:48.477ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55172026-03-03T16:56:48.477ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
55182026-03-03T16:56:48.477ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
55192026-03-03T16:56:48.477ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
55202026-03-03T16:56:48.477ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
55212026-03-03T16:56:48.477ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
55222026-03-03T16:56:48.479ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a982ef0-8603-4dc3-b01a-903b6635c558", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55232026-03-03T16:56:48.479ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=1
55242026-03-03T16:56:48.479ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55252026-03-03T16:56:48.482ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
55262026-03-03T16:56:48.482ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
55272026-03-03T16:56:48.482ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
55282026-03-03T16:56:48.482ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
55292026-03-03T16:56:48.482ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55302026-03-03T16:56:48.483ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55312026-03-03T16:56:48.484ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f64242a-0722-4698-845d-54ffa9f76f0e", "content-length": "111", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55322026-03-03T16:56:48.484ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=0
55332026-03-03T16:56:48.485ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "921777e2-6eec-4886-a864-013f2ef5673b", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55342026-03-03T16:56:48.485ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=1
55352026-03-03T16:56:48.485ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce92217a-3913-43aa-ab80-14c4e9404617", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55362026-03-03T16:56:48.485ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=0
55372026-03-03T16:56:48.486ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cbf965f-38e7-4aae-96d5-105425965181", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55382026-03-03T16:56:48.486ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=1
55392026-03-03T16:56:48.487ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e2f3401-9e70-4e90-b778-6c144b8c2d57", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55402026-03-03T16:56:48.487ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cmpa
55412026-03-03T16:56:48.487ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55422026-03-03T16:56:48.490ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
55432026-03-03T16:56:48.490ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
55442026-03-03T16:56:48.490ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55452026-03-03T16:56:48.491ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55462026-03-03T16:56:48.491ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
55472026-03-03T16:56:48.491ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
55482026-03-03T16:56:48.491ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
55492026-03-03T16:56:48.492ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
55502026-03-03T16:56:48.492ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8369779-575f-4abb-8d7f-54f16d3776db", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55512026-03-03T16:56:48.492ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
55522026-03-03T16:56:48.493ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
55532026-03-03T16:56:48.493ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 98.797997ms iteration = 5 status = {"blueprint_id":"17e53f87-23ca-4758-8dd3-9566e405f268","inventory_collection_id":"1676add0-b86f-4425-8460-eb4c84941409","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
55542026-03-03T16:56:48.493ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ca26391-e965-45bd-b373-305e44e7b6d7", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55552026-03-03T16:56:48.493ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
55562026-03-03T16:56:48.494ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "36e32f1c-cc02-44cb-b73e-853301ebece7", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55572026-03-03T16:56:48.494ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/switch/1/component/rot/cfpa
55582026-03-03T16:56:48.494ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6439a42e-a7a1-4649-8020-7864ada6594a", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55592026-03-03T16:56:48.494ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0
55602026-03-03T16:56:48.495ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1918776-d5ec-4879-b19d-cfc0a1e1d792", "content-length": "723", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55612026-03-03T16:56:48.495ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/active-slot
55622026-03-03T16:56:48.496ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2dfc86f-a5cc-4f18-8101-1b1d59b0a669", "content-length": "10", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55632026-03-03T16:56:48.496ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/0
55642026-03-03T16:56:48.496ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "229aea82-bbc2-44d7-bb20-ba646a5ec2e6", "content-length": "144", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55652026-03-03T16:56:48.496ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/1
55662026-03-03T16:56:48.497ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d5d5f6e-3633-4033-8280-54fdf9ff2715", "content-length": "147", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55672026-03-03T16:56:48.497ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=0
55682026-03-03T16:56:48.497ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "66c03d1b-39bf-470b-b9c0-43e19c802d17", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55692026-03-03T16:56:48.497ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=1
55702026-03-03T16:56:48.498ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "18334525-c8cb-4fb9-b2b6-4b55fb4ad941", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55712026-03-03T16:56:48.498ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=0
55722026-03-03T16:56:48.499ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9acadc5-2ed3-48cf-84be-09a6796872d7", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55732026-03-03T16:56:48.499ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=1
55742026-03-03T16:56:48.499ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1e8b633-9765-424b-97d5-5cb7d7e0d3e2", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55752026-03-03T16:56:48.499ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=0
55762026-03-03T16:56:48.500ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "485ba167-0bba-4105-a0ca-bd34dfa3fa47", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55772026-03-03T16:56:48.500ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=1
55782026-03-03T16:56:48.501ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3242b770-8cd6-4053-aade-529a3a195817", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55792026-03-03T16:56:48.501ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cmpa
55802026-03-03T16:56:48.501ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d66e72d0-bc2a-45f0-a6f5-5c5b0525228e", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55812026-03-03T16:56:48.501ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
55822026-03-03T16:56:48.502ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "071a04c1-1b21-4cf3-9a44-d8ef2297a9ac", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55832026-03-03T16:56:48.502ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
55842026-03-03T16:56:48.502ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b206b9c-aa68-4d1d-818c-9de99c980576", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55852026-03-03T16:56:48.502ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/0/component/rot/cfpa
55862026-03-03T16:56:48.503ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9588c1c5-a403-4430-bc91-5891409737b4", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55872026-03-03T16:56:48.503ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1
55882026-03-03T16:56:48.503ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
55892026-03-03T16:56:48.503ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
55902026-03-03T16:56:48.504ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b538c121-02b5-4f02-8ceb-a751acffdd97", "content-length": "723", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55912026-03-03T16:56:48.504ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/active-slot
55922026-03-03T16:56:48.504ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e708906-7c2f-40c8-ac56-e7f16d1c6dd0", "content-length": "10", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55932026-03-03T16:56:48.504ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/0
55942026-03-03T16:56:48.505ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d4b98eb-962f-4808-8cc2-c13e9d6984cd", "content-length": "144", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55952026-03-03T16:56:48.505ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/1
55962026-03-03T16:56:48.505ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbe1741e-46aa-4d3d-b279-17784aa9edc8", "content-length": "147", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55972026-03-03T16:56:48.505ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=0
55982026-03-03T16:56:48.506ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a66bef10-56c6-4887-865a-e7eb979ed098", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
55992026-03-03T16:56:48.506ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=1
56002026-03-03T16:56:48.507ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ad1040b-fd34-40b6-b2f1-87c4dab0ea80", "content-length": "109", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56012026-03-03T16:56:48.507ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=0
56022026-03-03T16:56:48.507ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b19305b-5d07-44ce-a1f3-2b01765b3e76", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56032026-03-03T16:56:48.507ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=1
56042026-03-03T16:56:48.508ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd8f692c-4333-429f-8030-5211f1386229", "content-length": "163", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56052026-03-03T16:56:48.508ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=0
56062026-03-03T16:56:48.509ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "397d99a2-fe19-449b-a5cc-51df90fb2232", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56072026-03-03T16:56:48.509ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=1
56082026-03-03T16:56:48.509ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff7566d5-e08b-4282-8d80-7da5270ee39e", "content-length": "166", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56092026-03-03T16:56:48.509ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cmpa
56102026-03-03T16:56:48.510ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a0b4604-39b4-457f-ab52-07609a06cd60", "content-length": "702", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56112026-03-03T16:56:48.510ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
56122026-03-03T16:56:48.510ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "60658969-f007-42fb-a6a5-1d0255c618d3", "content-length": "727", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56132026-03-03T16:56:48.510ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
56142026-03-03T16:56:48.511ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bbb21fb-a593-42d9-8e87-600034cdcb8b", "content-length": "729", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56152026-03-03T16:56:48.511ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:36753 method = GET uri = http://[::1]:36753/sp/sled/1/component/rot/cfpa
56162026-03-03T16:56:48.511ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:36753 result = Ok(Response { url: "http://[::1]:36753/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bfbe83f-d179-487a-8829-b33bd83d62da", "content-length": "728", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56172026-03-03T16:56:48.511ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
56182026-03-03T16:56:48.511ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56192026-03-03T16:56:48.511ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
56202026-03-03T16:56:48.511ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56212026-03-03T16:56:48.512ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
56222026-03-03T16:56:48.513ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56232026-03-03T16:56:48.516ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
56242026-03-03T16:56:48.516ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
56252026-03-03T16:56:48.516ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56262026-03-03T16:56:48.516ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
56272026-03-03T16:56:48.516ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56282026-03-03T16:56:48.517ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
56292026-03-03T16:56:48.517ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
56302026-03-03T16:56:48.517ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
56312026-03-03T16:56:48.517ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
56322026-03-03T16:56:48.517ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
56332026-03-03T16:56:48.517ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
56342026-03-03T16:56:48.518ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56352026-03-03T16:56:48.521ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
56362026-03-03T16:56:48.521ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
56372026-03-03T16:56:48.521ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56382026-03-03T16:56:48.522ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
56392026-03-03T16:56:48.522ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
56402026-03-03T16:56:48.522ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
56412026-03-03T16:56:48.524ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
56422026-03-03T16:56:48.524ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 128.581564ms iteration = 5 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
56432026-03-03T16:56:48.534ZDEBGtest_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:33115
56442026-03-03T16:56:48.534ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = http://[::1]:33115 background_task = inventory_collection body = None method = GET uri = http://[::1]:33115/inventory
56452026-03-03T16:56:48.534ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47682 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
56462026-03-03T16:56:48.535ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = GET remote_addr = [::1]:47682 req_id = 9f0c6d96-5b1c-4156-8e72-b290cc329c1c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
56472026-03-03T16:56:48.535ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = GET remote_addr = [::1]:47682 req_id = 9f0c6d96-5b1c-4156-8e72-b290cc329c1c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
56482026-03-03T16:56:48.536ZINFOtest_metrics (dropshot): request completed latency_us = 1039 local_addr = [::1]:33115 method = GET remote_addr = [::1]:47682 req_id = 9f0c6d96-5b1c-4156-8e72-b290cc329c1c response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
56492026-03-03T16:56:48.536ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = http://[::1]:33115 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:33115/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f0c6d96-5b1c-4156-8e72-b290cc329c1c", "content-length": "19983", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56502026-03-03T16:56:48.537ZDEBGtest_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
56512026-03-03T16:56:48.537ZDEBGtest_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
56522026-03-03T16:56:48.537ZDEBGtest_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
56532026-03-03T16:56:48.537ZDEBGtest_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
56542026-03-03T16:56:48.538ZDEBGtest_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
56552026-03-03T16:56:48.538ZWARNtest_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
56562026-03-03T16:56:48.546ZDEBGtest_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 00202f40-5fe9-436d-80ec-5125a4b6d9f1 (omicron_zone)
56572026-03-03T16:56:48.546ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
56582026-03-03T16:56:48.546ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
56592026-03-03T16:56:48.546ZDEBGtest_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
56602026-03-03T16:56:48.555ZDEBGtest_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 5af26469-64ce-4f90-bbd5-93c35e3638d1 (omicron_zone)
56612026-03-03T16:56:48.555ZDEBGtest_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:43957 method = GET uri = http://[::1]:43957/config
56622026-03-03T16:56:48.555ZINFOtest_metrics (http): accepted connection kind = dns local_addr = [::1]:43957 remote_addr = [::1]:55850
56632026-03-03T16:56:48.555ZTRACtest_metrics (http): incoming request kind = dns local_addr = [::1]:43957 method = GET remote_addr = [::1]:55850 req_id = 641ff955-3a5f-42c7-bb51-5167a224c15d uri = /config
56642026-03-03T16:56:48.555ZDEBGtest_metrics (http): determined request API version kind = dns local_addr = [::1]:43957 method = GET remote_addr = [::1]:55850 req_id = 641ff955-3a5f-42c7-bb51-5167a224c15d uri = /config version = 2.0.0
56652026-03-03T16:56:48.556ZINFOtest_metrics (http): request completed kind = dns latency_us = 560 local_addr = [::1]:43957 method = GET remote_addr = [::1]:55850 req_id = 641ff955-3a5f-42c7-bb51-5167a224c15d response_code = 200 uri = /config
56662026-03-03T16:56:48.556ZDEBGtest_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:43957 result = Ok(Response { url: "http://[::1]:43957/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "641ff955-3a5f-42c7-bb51-5167a224c15d", "content-length": "3478", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56672026-03-03T16:56:48.556ZDEBGtest_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 5af26469-64ce-4f90-bbd5-93c35e3638d1 (omicron_zone)
56682026-03-03T16:56:48.556ZDEBGtest_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
56692026-03-03T16:56:48.556ZDEBGtest_metrics (BackgroundTasks): finished collection background_task = inventory_collection
56702026-03-03T16:56:48.557ZTRACtest_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
56712026-03-03T16:56:48.557ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56722026-03-03T16:56:48.557ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
56732026-03-03T16:56:48.557ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56742026-03-03T16:56:48.557ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
56752026-03-03T16:56:48.559ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56762026-03-03T16:56:48.562ZDEBGtest_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
56772026-03-03T16:56:48.562ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
56782026-03-03T16:56:48.562ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56792026-03-03T16:56:48.563ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
56802026-03-03T16:56:48.576ZINFOtest_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
56812026-03-03T16:56:48.576ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
56822026-03-03T16:56:48.577ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84b67dcc-a8fd-4673-9b90-e8791c68ece8 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
56832026-03-03T16:56:48.577ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84b67dcc-a8fd-4673-9b90-e8791c68ece8 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
56842026-03-03T16:56:48.577ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84b67dcc-a8fd-4673-9b90-e8791c68ece8 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
56852026-03-03T16:56:48.577ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84b67dcc-a8fd-4673-9b90-e8791c68ece8 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
56862026-03-03T16:56:48.577ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84b67dcc-a8fd-4673-9b90-e8791c68ece8 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
56872026-03-03T16:56:48.579ZINFOtest_metrics (dropshot_internal): request completed latency_us = 2701 local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84b67dcc-a8fd-4673-9b90-e8791c68ece8 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
56882026-03-03T16:56:48.580ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "84b67dcc-a8fd-4673-9b90-e8791c68ece8", "content-length": "405", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56892026-03-03T16:56:48.580ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
56902026-03-03T16:56:48.580ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 0ad312b8-bea1-4fcb-bb68-5234b266eb53 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
56912026-03-03T16:56:48.580ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 0ad312b8-bea1-4fcb-bb68-5234b266eb53 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
56922026-03-03T16:56:48.580ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 0ad312b8-bea1-4fcb-bb68-5234b266eb53 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
56932026-03-03T16:56:48.580ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 0ad312b8-bea1-4fcb-bb68-5234b266eb53 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
56942026-03-03T16:56:48.581ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 0ad312b8-bea1-4fcb-bb68-5234b266eb53 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
56952026-03-03T16:56:48.582ZINFOtest_metrics (dropshot_internal): request completed latency_us = 2329 local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 0ad312b8-bea1-4fcb-bb68-5234b266eb53 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
56962026-03-03T16:56:48.583ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ad312b8-bea1-4fcb-bb68-5234b266eb53", "content-length": "29", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
56972026-03-03T16:56:48.583ZDEBGtest_metrics (oximeter-agent): registered new metric producer address = 127.0.0.1:44271 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
56982026-03-03T16:56:48.583ZDEBGtest_metrics (oximeter-agent): registered new metric producer address = [::1]:40827 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
56992026-03-03T16:56:48.583ZINFOtest_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
57002026-03-03T16:56:48.591ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
57012026-03-03T16:56:48.600ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
57022026-03-03T16:56:48.600ZDEBGtest_metrics (collection-task): reporting oximeter self-collection statistics collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
57032026-03-03T16:56:48.600ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
57042026-03-03T16:56:48.601ZDEBGtest_metrics (collection-task): reporting oximeter self-collection statistics collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
57052026-03-03T16:56:48.601ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
57062026-03-03T16:56:48.601ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
57072026-03-03T16:56:48.601ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
57082026-03-03T16:56:48.602ZINFOtest_metrics (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = 127.0.0.1:44271 remote_addr = 127.0.0.1:44728
57092026-03-03T16:56:48.602ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 70b5e971-8eed-4686-b279-4f98b6a846ce uri = /913233fe-92a8-4635-9572-183f495429c4
57102026-03-03T16:56:48.605ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 3824 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 70b5e971-8eed-4686-b279-4f98b6a846ce response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
57112026-03-03T16:56:48.606ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
57122026-03-03T16:56:48.606ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
57132026-03-03T16:56:48.606ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
57142026-03-03T16:56:48.606ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
57152026-03-03T16:56:48.606ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
57162026-03-03T16:56:48.613ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
57172026-03-03T16:56:48.613ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
57182026-03-03T16:56:48.613ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
57192026-03-03T16:56:48.613ZDEBGtest_metrics (results-sink): inserting 24 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57202026-03-03T16:56:48.614ZDEBGtest_metrics (results-sink-cluster): inserting 24 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57212026-03-03T16:56:48.614ZDEBGtest_metrics (clickhouse-client): unrolling 24 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57222026-03-03T16:56:48.614ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57232026-03-03T16:56:48.614ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = SELECT * FROM oximeter.timeseries_schema FORMAT Native;
57242026-03-03T16:56:48.615ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57252026-03-03T16:56:48.615ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T16:56:48.614405117Z } timeseries_name = oximeter_collector:collections
57262026-03-03T16:56:48.616ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57272026-03-03T16:56:48.616ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('oximeter_collector:collections') FORMAT Native;
57282026-03-03T16:56:48.617ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57292026-03-03T16:56:48.617ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 schema = TimeseriesSchema { timeseries_name: TimeseriesName("integration_target:integration_metric"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "metric_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "target_name", field_type: String, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T16:56:48.616581991Z } timeseries_name = integration_target:integration_metric
57302026-03-03T16:56:48.618ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57312026-03-03T16:56:48.618ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
57322026-03-03T16:56:48.618ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57332026-03-03T16:56:48.619ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T16:56:48.618079453Z } timeseries_name = http_service:request_latency_histogram
57342026-03-03T16:56:48.622ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57352026-03-03T16:56:48.622ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('http_service:request_latency_histogram', 'integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
57362026-03-03T16:56:48.623ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57372026-03-03T16:56:48.623ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T16:56:48.622240810Z } timeseries_name = collection_target:cpus_provisioned
57382026-03-03T16:56:48.623ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57392026-03-03T16:56:48.623ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('collection_target:cpus_provisioned', 'http_service:request_latency_histogram', 'integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
57402026-03-03T16:56:48.624ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57412026-03-03T16:56:48.624ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T16:56:48.623653082Z } timeseries_name = collection_target:ram_provisioned
57422026-03-03T16:56:48.625ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57432026-03-03T16:56:48.625ZTRACtest_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('collection_target:cpus_provisioned', 'collection_target:ram_provisioned', 'http_service:request_latency_histogram', 'integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
57442026-03-03T16:56:48.625ZTRACtest_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57452026-03-03T16:56:48.626ZDEBGtest_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T16:56:48.625078714Z } timeseries_name = collection_target:virtual_disk_space_provisioned
57462026-03-03T16:56:48.629ZDEBGtest_metrics (clickhouse-client): inserting 6 new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
57472026-03-03T16:56:48.629ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 6 n_rows = 6 sql = INSERT INTO oximeter.timeseries_schema FORMAT Native
57482026-03-03T16:56:48.631ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 4 sql = INSERT INTO oximeter.fields_ipaddr FORMAT Native
57492026-03-03T16:56:48.632ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 4 table_name = fields_ipaddr
57502026-03-03T16:56:48.632ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
57512026-03-03T16:56:48.633ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 22 table_name = fields_string
57522026-03-03T16:56:48.633ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 13 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
57532026-03-03T16:56:48.634ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 13 table_name = fields_u16
57542026-03-03T16:56:48.634ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 25 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
57552026-03-03T16:56:48.635ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 25 table_name = fields_uuid
57562026-03-03T16:56:48.635ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 5 n_rows = 2 sql = INSERT INTO oximeter.measurements_cumulativeu64 FORMAT Native
57572026-03-03T16:56:48.636ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = measurements_cumulativeu64
57582026-03-03T16:56:48.636ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 9 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
57592026-03-03T16:56:48.637ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 9 table_name = measurements_histogramu64
57602026-03-03T16:56:48.637ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 13 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
57612026-03-03T16:56:48.638ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 13 table_name = measurements_i64
57622026-03-03T16:56:48.638ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57632026-03-03T16:56:48.658ZINFOtest_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 265659bf-7b99-48c2-a603-7b8d06134310
57642026-03-03T16:56:48.659ZDEBGtest_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 265659bf-7b99-48c2-a603-7b8d06134310 time_started = 2026-03-03 16:56:48.460515 UTC
57652026-03-03T16:56:48.659ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 327.872991ms iteration = 7 status = {"collection_id":"265659bf-7b99-48c2-a603-7b8d06134310","time_done":"2026-03-03 16:56:48.556982 UTC","time_started":"2026-03-03 16:56:48.460515 UTC"}
57662026-03-03T16:56:48.659ZDEBGtest_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 6 reason = Dependency
57672026-03-03T16:56:48.659ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
57682026-03-03T16:56:48.659ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57692026-03-03T16:56:48.659ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
57702026-03-03T16:56:48.659ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
57712026-03-03T16:56:48.660ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
57722026-03-03T16:56:48.664ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57732026-03-03T16:56:48.668ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
57742026-03-03T16:56:48.668ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
57752026-03-03T16:56:48.668ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
57762026-03-03T16:56:48.668ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
57772026-03-03T16:56:48.669ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
57782026-03-03T16:56:48.669ZDEBGtest_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
57792026-03-03T16:56:48.670ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
57802026-03-03T16:56:48.691ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 32.138671ms iteration = 6 status = {"Loaded":{"collection_id":"265659bf-7b99-48c2-a603-7b8d06134310","time_loaded":"2026-03-03T16:56:48.659582749Z","time_started":"2026-03-03T16:56:48.460515Z"}}
57812026-03-03T16:56:48.691ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 8 reason = Dependency
57822026-03-03T16:56:48.691ZDEBGtest_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
57832026-03-03T16:56:48.691ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 41.11\u{b5}s iteration = 8 status = "Disabled"
57842026-03-03T16:56:48.691ZDEBGtest_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
57852026-03-03T16:56:48.691ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
57862026-03-03T16:56:48.691ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57872026-03-03T16:56:48.691ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
57882026-03-03T16:56:48.691ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
57892026-03-03T16:56:48.692ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
57902026-03-03T16:56:48.692ZDEBGtest_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Dependency
57912026-03-03T16:56:48.692ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 20.57\u{b5}s iteration = 6 status = {"error":"task disabled"}
57922026-03-03T16:56:48.692ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 6 reason = Dependency
57932026-03-03T16:56:48.693ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
57942026-03-03T16:56:48.693ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
57952026-03-03T16:56:48.693ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
57962026-03-03T16:56:48.693ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 2f 45 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 /E..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:62369 req_id = 1003432b-5090-42cc-b82b-41fb06bf3e6c
57972026-03-03T16:56:48.693ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 12101,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:62369 req_id = 1003432b-5090-42cc-b82b-41fb06bf3e6c
57982026-03-03T16:56:48.693ZDEBGtest_metrics (store): query key key = _dendrite._tcp
57992026-03-03T16:56:48.693ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
58002026-03-03T16:56:48.693ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:62369 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 1003432b-5090-42cc-b82b-41fb06bf3e6c
58012026-03-03T16:56:48.694ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1870, tv_nsec: 950707492 } })
58022026-03-03T16:56:48.694ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
58032026-03-03T16:56:48.694ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: ce de 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:56033 req_id = 12a1700a-ef79-4b47-a008-672494702782
58042026-03-03T16:56:48.694ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 52958,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:56033 req_id = 12a1700a-ef79-4b47-a008-672494702782
58052026-03-03T16:56:48.694ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
58062026-03-03T16:56:48.694ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:56033 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 12a1700a-ef79-4b47-a008-672494702782
58072026-03-03T16:56:48.694ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58082026-03-03T16:56:48.697ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58092026-03-03T16:56:48.697ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58102026-03-03T16:56:48.697ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58112026-03-03T16:56:48.697ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58122026-03-03T16:56:48.697ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58132026-03-03T16:56:48.698ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58142026-03-03T16:56:48.717ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:42205/switch/identifiers
58152026-03-03T16:56:48.717ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
58162026-03-03T16:56:48.718ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:42205/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb20cc7f-790f-45f5-86d6-616ebcbf508d", "content-length": "206", "date": "Tue, 03 Mar 2026 16:56:48 GMT"} })
58172026-03-03T16:56:48.718ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
58182026-03-03T16:56:48.718ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
58192026-03-03T16:56:48.718ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
58202026-03-03T16:56:48.718ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
58212026-03-03T16:56:48.719ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58222026-03-03T16:56:48.722ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58232026-03-03T16:56:48.722ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58242026-03-03T16:56:48.722ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58252026-03-03T16:56:48.722ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58262026-03-03T16:56:48.724ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
58272026-03-03T16:56:48.724ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
58282026-03-03T16:56:48.724ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
58292026-03-03T16:56:48.724ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
58302026-03-03T16:56:48.724ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
58312026-03-03T16:56:48.725ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58322026-03-03T16:56:48.725ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58332026-03-03T16:56:48.725ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58342026-03-03T16:56:48.725ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58352026-03-03T16:56:48.725ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58362026-03-03T16:56:48.726ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58372026-03-03T16:56:48.729ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58382026-03-03T16:56:48.729ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58392026-03-03T16:56:48.729ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58402026-03-03T16:56:48.729ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58412026-03-03T16:56:48.729ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58422026-03-03T16:56:48.730ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58432026-03-03T16:56:48.730ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
58442026-03-03T16:56:48.730ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
58452026-03-03T16:56:48.730ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
58462026-03-03T16:56:48.730ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
58472026-03-03T16:56:48.730ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
58482026-03-03T16:56:48.731ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58492026-03-03T16:56:48.734ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58502026-03-03T16:56:48.734ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58512026-03-03T16:56:48.734ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58522026-03-03T16:56:48.735ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58532026-03-03T16:56:48.736ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
58542026-03-03T16:56:48.736ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
58552026-03-03T16:56:48.736ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
58562026-03-03T16:56:48.736ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
58572026-03-03T16:56:48.736ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
58582026-03-03T16:56:48.736ZINFOtest_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
58592026-03-03T16:56:48.736ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58602026-03-03T16:56:48.736ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58612026-03-03T16:56:48.736ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58622026-03-03T16:56:48.737ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58632026-03-03T16:56:48.737ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58642026-03-03T16:56:48.739ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
58652026-03-03T16:56:48.739ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
58662026-03-03T16:56:48.739ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
58672026-03-03T16:56:48.739ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
58682026-03-03T16:56:48.740ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58692026-03-03T16:56:48.742ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58702026-03-03T16:56:48.743ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58712026-03-03T16:56:48.743ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58722026-03-03T16:56:48.743ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58732026-03-03T16:56:48.743ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58742026-03-03T16:56:48.743ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58752026-03-03T16:56:48.744ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58762026-03-03T16:56:48.747ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58772026-03-03T16:56:48.747ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58782026-03-03T16:56:48.747ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58792026-03-03T16:56:48.747ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58802026-03-03T16:56:48.748ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
58812026-03-03T16:56:48.748ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
58822026-03-03T16:56:48.748ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
58832026-03-03T16:56:48.748ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
58842026-03-03T16:56:48.748ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
58852026-03-03T16:56:48.749ZINFOtest_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
58862026-03-03T16:56:48.749ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58872026-03-03T16:56:48.749ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58882026-03-03T16:56:48.749ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
58892026-03-03T16:56:48.749ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58902026-03-03T16:56:48.749ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58912026-03-03T16:56:48.750ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
58922026-03-03T16:56:48.750ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
58932026-03-03T16:56:48.751ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
58942026-03-03T16:56:48.751ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 58.762743ms iteration = 6 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
58952026-03-03T16:56:48.752ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58962026-03-03T16:56:48.756ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
58972026-03-03T16:56:48.756ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
58982026-03-03T16:56:48.756ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58992026-03-03T16:56:48.756ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
59002026-03-03T16:56:48.756ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59012026-03-03T16:56:48.757ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59022026-03-03T16:56:48.758ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59032026-03-03T16:56:48.761ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
59042026-03-03T16:56:48.761ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
59052026-03-03T16:56:48.761ZDEBGtest_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59062026-03-03T16:56:48.761ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59072026-03-03T16:56:48.763ZINFOtest_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
59082026-03-03T16:56:48.763ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 71.317763ms iteration = 6 status = {"blueprint_id":"17e53f87-23ca-4758-8dd3-9566e405f268","inventory_collection_id":"265659bf-7b99-48c2-a603-7b8d06134310","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
59092026-03-03T16:56:49.405ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59102026-03-03T16:56:49.405ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
59112026-03-03T16:56:49.405ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
59122026-03-03T16:56:49.405ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
59132026-03-03T16:56:49.405ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
59142026-03-03T16:56:49.406ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
59152026-03-03T16:56:49.406ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
59162026-03-03T16:56:49.406ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59172026-03-03T16:56:49.406ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1 version = 2026021900.0.0
59182026-03-03T16:56:49.406ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = f73de001-5ad9-407d-86d0-258c9b7a75e2 uri = /913233fe-92a8-4635-9572-183f495429c4
59192026-03-03T16:56:49.406ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59202026-03-03T16:56:49.406ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59212026-03-03T16:56:49.407ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59222026-03-03T16:56:49.407ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59232026-03-03T16:56:49.407ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59242026-03-03T16:56:49.414ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7398 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = f73de001-5ad9-407d-86d0-258c9b7a75e2 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
59252026-03-03T16:56:49.414ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
59262026-03-03T16:56:49.419ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
59272026-03-03T16:56:49.419ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
59282026-03-03T16:56:49.419ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
59292026-03-03T16:56:49.419ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
59302026-03-03T16:56:49.419ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
59312026-03-03T16:56:49.419ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
59322026-03-03T16:56:49.419ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
59332026-03-03T16:56:49.419ZDEBGtest_metrics (results-sink): inserting 9 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
59342026-03-03T16:56:49.419ZDEBGtest_metrics (results-sink-cluster): inserting 9 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
59352026-03-03T16:56:49.420ZDEBGtest_metrics (clickhouse-client): unrolling 9 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
59362026-03-03T16:56:49.423ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 18 sql = INSERT INTO oximeter.fields_string FORMAT Native
59372026-03-03T16:56:49.423ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59382026-03-03T16:56:49.423ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59392026-03-03T16:56:49.427ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59402026-03-03T16:56:49.427ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 18 table_name = fields_string
59412026-03-03T16:56:49.427ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 9 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
59422026-03-03T16:56:49.427ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
59432026-03-03T16:56:49.427ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
59442026-03-03T16:56:49.427ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59452026-03-03T16:56:49.427ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59462026-03-03T16:56:49.427ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59472026-03-03T16:56:49.428ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 9 table_name = fields_u16
59482026-03-03T16:56:49.428ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 9 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
59492026-03-03T16:56:49.432ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
59502026-03-03T16:56:49.432ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59512026-03-03T16:56:49.432ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59522026-03-03T16:56:49.433ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59532026-03-03T16:56:49.434ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 9 table_name = fields_uuid
59542026-03-03T16:56:49.434ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 9 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
59552026-03-03T16:56:49.435ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
59562026-03-03T16:56:49.438ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
59572026-03-03T16:56:49.438ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59582026-03-03T16:56:49.438ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59592026-03-03T16:56:49.439ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59602026-03-03T16:56:49.439ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 9 table_name = measurements_histogramu64
59612026-03-03T16:56:49.439ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
59622026-03-03T16:56:49.439ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
59632026-03-03T16:56:49.440ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
59642026-03-03T16:56:49.440ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
59652026-03-03T16:56:49.443ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
59662026-03-03T16:56:49.443ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
59672026-03-03T16:56:49.443ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59682026-03-03T16:56:49.443ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59692026-03-03T16:56:49.444ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59702026-03-03T16:56:49.446ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
59712026-03-03T16:56:49.446ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
59722026-03-03T16:56:49.447ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
59732026-03-03T16:56:49.449ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59742026-03-03T16:56:49.449ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59752026-03-03T16:56:49.450ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59762026-03-03T16:56:49.452ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
59772026-03-03T16:56:49.453ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
59782026-03-03T16:56:49.453ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
59792026-03-03T16:56:49.454ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
59802026-03-03T16:56:49.455ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59812026-03-03T16:56:49.455ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59822026-03-03T16:56:49.455ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59832026-03-03T16:56:49.455ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59842026-03-03T16:56:49.455ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59852026-03-03T16:56:49.455ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59862026-03-03T16:56:49.459ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59872026-03-03T16:56:49.462ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59882026-03-03T16:56:49.462ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59892026-03-03T16:56:49.463ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59902026-03-03T16:56:49.463ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59912026-03-03T16:56:49.463ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59922026-03-03T16:56:49.463ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59932026-03-03T16:56:49.469ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59942026-03-03T16:56:49.490ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
59952026-03-03T16:56:49.491ZDEBGtest_metrics (clickhouse-client): retrieving timeseries schema from database id = 0bd623cd-5825-4477-b3ca-107a738cbd60
59962026-03-03T16:56:49.491ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.timeseries_schema FORMAT Native;
59972026-03-03T16:56:49.492ZTRACtest_metrics (clickhouse-client): retrieved new timeseries schema id = 0bd623cd-5825-4477-b3ca-107a738cbd60 n_schema = 6
59982026-03-03T16:56:49.495ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
59992026-03-03T16:56:49.497ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (12379067900625785140) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:49.405641094' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
60002026-03-03T16:56:49.502ZINFOtest_metrics (dropshot_external): request completed latency_us = 94992 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = da2be860-c07a-4b77-a2c0-be69d5a04374 response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.405641094Z&order=descending&limit=1
60012026-03-03T16:56:49.502ZINFOtest_metrics (external client test context): client received response status = 200
60022026-03-03T16:56:49.502ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60032026-03-03T16:56:49.503ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
60042026-03-03T16:56:49.503ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
60052026-03-03T16:56:49.503ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60062026-03-03T16:56:49.503ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60072026-03-03T16:56:49.503ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
60082026-03-03T16:56:49.503ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60092026-03-03T16:56:49.503ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60102026-03-03T16:56:49.503ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1 version = 2026021900.0.0
60112026-03-03T16:56:49.511ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = d13e6fd6-e8ed-4493-9f75-7d09a13f67be uri = /913233fe-92a8-4635-9572-183f495429c4
60122026-03-03T16:56:49.512ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60132026-03-03T16:56:49.512ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60142026-03-03T16:56:49.512ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60152026-03-03T16:56:49.512ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60162026-03-03T16:56:49.519ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60172026-03-03T16:56:49.519ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5836 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = d13e6fd6-e8ed-4493-9f75-7d09a13f67be response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
60182026-03-03T16:56:49.519ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60192026-03-03T16:56:49.519ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
60202026-03-03T16:56:49.519ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60212026-03-03T16:56:49.519ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60222026-03-03T16:56:49.519ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60232026-03-03T16:56:49.519ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60242026-03-03T16:56:49.523ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
60252026-03-03T16:56:49.523ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
60262026-03-03T16:56:49.523ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
60272026-03-03T16:56:49.523ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60282026-03-03T16:56:49.523ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
60292026-03-03T16:56:49.524ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
60302026-03-03T16:56:49.528ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
60312026-03-03T16:56:49.528ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60322026-03-03T16:56:49.528ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60332026-03-03T16:56:49.528ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60342026-03-03T16:56:49.528ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60352026-03-03T16:56:49.528ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60362026-03-03T16:56:49.529ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
60372026-03-03T16:56:49.529ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
60382026-03-03T16:56:49.530ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
60392026-03-03T16:56:49.530ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
60402026-03-03T16:56:49.530ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60412026-03-03T16:56:49.530ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60422026-03-03T16:56:49.531ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60432026-03-03T16:56:49.531ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
60442026-03-03T16:56:49.531ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60452026-03-03T16:56:49.531ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60462026-03-03T16:56:49.531ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
60472026-03-03T16:56:49.535ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
60482026-03-03T16:56:49.537ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
60492026-03-03T16:56:49.537ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60502026-03-03T16:56:49.537ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60512026-03-03T16:56:49.537ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60522026-03-03T16:56:49.538ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 20 table_name = fields_string
60532026-03-03T16:56:49.541ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
60542026-03-03T16:56:49.542ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_u16
60552026-03-03T16:56:49.542ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
60562026-03-03T16:56:49.543ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_uuid
60572026-03-03T16:56:49.543ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
60582026-03-03T16:56:49.545ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = measurements_histogramu64
60592026-03-03T16:56:49.545ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60602026-03-03T16:56:49.548ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
60612026-03-03T16:56:49.551ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
60622026-03-03T16:56:49.551ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60632026-03-03T16:56:49.551ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60642026-03-03T16:56:49.551ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60652026-03-03T16:56:49.553ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
60662026-03-03T16:56:49.554ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
60672026-03-03T16:56:49.554ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60682026-03-03T16:56:49.554ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60692026-03-03T16:56:49.554ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60702026-03-03T16:56:49.564ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
60712026-03-03T16:56:49.565ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60722026-03-03T16:56:49.565ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60732026-03-03T16:56:49.565ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60742026-03-03T16:56:49.567ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
60752026-03-03T16:56:49.569ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
60762026-03-03T16:56:49.570ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60772026-03-03T16:56:49.570ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60782026-03-03T16:56:49.570ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60792026-03-03T16:56:49.570ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60802026-03-03T16:56:49.570ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60812026-03-03T16:56:49.570ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60822026-03-03T16:56:49.572ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60832026-03-03T16:56:49.579ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60842026-03-03T16:56:49.579ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60852026-03-03T16:56:49.579ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60862026-03-03T16:56:49.579ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60872026-03-03T16:56:49.579ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60882026-03-03T16:56:49.579ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60892026-03-03T16:56:49.581ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60902026-03-03T16:56:49.584ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
60912026-03-03T16:56:49.586ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
60922026-03-03T16:56:49.586ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60932026-03-03T16:56:49.587ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60942026-03-03T16:56:49.588ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60952026-03-03T16:56:49.588ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60962026-03-03T16:56:49.588ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60972026-03-03T16:56:49.588ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
60982026-03-03T16:56:49.592ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (7763646387282271213) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:49.502048267' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
60992026-03-03T16:56:49.594ZINFOtest_metrics (dropshot_external): request completed latency_us = 91742 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = dbe7196c-e93c-4038-91bc-6bcd8c309610 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.502048267Z&order=descending&limit=1
61002026-03-03T16:56:49.594ZINFOtest_metrics (external client test context): client received response status = 200
61012026-03-03T16:56:49.595ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61022026-03-03T16:56:49.595ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
61032026-03-03T16:56:49.595ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
61042026-03-03T16:56:49.595ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
61052026-03-03T16:56:49.595ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
61062026-03-03T16:56:49.595ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
61072026-03-03T16:56:49.595ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
61082026-03-03T16:56:49.595ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61092026-03-03T16:56:49.595ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1 version = 2026021900.0.0
61102026-03-03T16:56:49.595ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 4e275b16-37bb-4bba-96a8-0a0651dfbce1 uri = /913233fe-92a8-4635-9572-183f495429c4
61112026-03-03T16:56:49.595ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61122026-03-03T16:56:49.595ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61132026-03-03T16:56:49.596ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61142026-03-03T16:56:49.596ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61152026-03-03T16:56:49.597ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61162026-03-03T16:56:49.604ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 8253 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 4e275b16-37bb-4bba-96a8-0a0651dfbce1 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
61172026-03-03T16:56:49.605ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61182026-03-03T16:56:49.605ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61192026-03-03T16:56:49.606ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61202026-03-03T16:56:49.607ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
61212026-03-03T16:56:49.612ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
61222026-03-03T16:56:49.612ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
61232026-03-03T16:56:49.612ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
61242026-03-03T16:56:49.612ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
61252026-03-03T16:56:49.613ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
61262026-03-03T16:56:49.613ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
61272026-03-03T16:56:49.613ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
61282026-03-03T16:56:49.613ZDEBGtest_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
61292026-03-03T16:56:49.613ZDEBGtest_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
61302026-03-03T16:56:49.617ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
61312026-03-03T16:56:49.619ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
61322026-03-03T16:56:49.619ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
61332026-03-03T16:56:49.619ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61342026-03-03T16:56:49.619ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61352026-03-03T16:56:49.620ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61362026-03-03T16:56:49.620ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 22 table_name = fields_string
61372026-03-03T16:56:49.620ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
61382026-03-03T16:56:49.626ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
61392026-03-03T16:56:49.626ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61402026-03-03T16:56:49.626ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61412026-03-03T16:56:49.626ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61422026-03-03T16:56:49.626ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_u16
61432026-03-03T16:56:49.626ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
61442026-03-03T16:56:49.626ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
61452026-03-03T16:56:49.627ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
61462026-03-03T16:56:49.627ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61472026-03-03T16:56:49.627ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61482026-03-03T16:56:49.627ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61492026-03-03T16:56:49.628ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_uuid
61502026-03-03T16:56:49.628ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
61512026-03-03T16:56:49.629ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
61522026-03-03T16:56:49.630ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
61532026-03-03T16:56:49.630ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = measurements_histogramu64
61542026-03-03T16:56:49.630ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
61552026-03-03T16:56:49.630ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
61562026-03-03T16:56:49.630ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
61572026-03-03T16:56:49.630ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61582026-03-03T16:56:49.630ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61592026-03-03T16:56:49.631ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61602026-03-03T16:56:49.632ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
61612026-03-03T16:56:49.632ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
61622026-03-03T16:56:49.632ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
61632026-03-03T16:56:49.632ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
61642026-03-03T16:56:49.632ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
61652026-03-03T16:56:49.633ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
61662026-03-03T16:56:49.633ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61672026-03-03T16:56:49.633ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61682026-03-03T16:56:49.634ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61692026-03-03T16:56:49.634ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
61702026-03-03T16:56:49.634ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
61712026-03-03T16:56:49.635ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
61722026-03-03T16:56:49.637ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
61732026-03-03T16:56:49.637ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61742026-03-03T16:56:49.637ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61752026-03-03T16:56:49.637ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61762026-03-03T16:56:49.638ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61772026-03-03T16:56:49.638ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61782026-03-03T16:56:49.638ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61792026-03-03T16:56:49.642ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
61802026-03-03T16:56:49.642ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
61812026-03-03T16:56:49.645ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61822026-03-03T16:56:49.648ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61832026-03-03T16:56:49.648ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61842026-03-03T16:56:49.648ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61852026-03-03T16:56:49.648ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61862026-03-03T16:56:49.648ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61872026-03-03T16:56:49.648ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61882026-03-03T16:56:49.666ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61892026-03-03T16:56:49.669ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61902026-03-03T16:56:49.671ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
61912026-03-03T16:56:49.676ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10733361587332781639) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:49.595021655' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
61922026-03-03T16:56:49.680ZINFOtest_metrics (dropshot_external): request completed latency_us = 83489 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a26bb352-56c3-4ce5-91d5-5f3e262bd9e9 response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.595021655Z&order=descending&limit=1
61932026-03-03T16:56:49.680ZINFOtest_metrics (external client test context): client received response status = 200
61942026-03-03T16:56:49.680ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61952026-03-03T16:56:49.680ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
61962026-03-03T16:56:49.680ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
61972026-03-03T16:56:49.680ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
61982026-03-03T16:56:49.680ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
61992026-03-03T16:56:49.680ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
62002026-03-03T16:56:49.680ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
62012026-03-03T16:56:49.680ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62022026-03-03T16:56:49.680ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
62032026-03-03T16:56:49.680ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = b6006020-2127-4466-b013-098e70b46f5c uri = /913233fe-92a8-4635-9572-183f495429c4
62042026-03-03T16:56:49.680ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62052026-03-03T16:56:49.680ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62062026-03-03T16:56:49.680ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
62072026-03-03T16:56:49.680ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
62082026-03-03T16:56:49.681ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
62092026-03-03T16:56:49.691ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 10832 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = b6006020-2127-4466-b013-098e70b46f5c response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
62102026-03-03T16:56:49.705ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
62112026-03-03T16:56:49.710ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
62122026-03-03T16:56:49.715ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
62132026-03-03T16:56:49.715ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
62142026-03-03T16:56:49.715ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
62152026-03-03T16:56:49.715ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
62162026-03-03T16:56:49.715ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
62172026-03-03T16:56:49.715ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
62182026-03-03T16:56:49.715ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
62192026-03-03T16:56:49.715ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
62202026-03-03T16:56:49.715ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
62212026-03-03T16:56:49.716ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
62222026-03-03T16:56:49.721ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
62232026-03-03T16:56:49.721ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
62242026-03-03T16:56:49.721ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
62252026-03-03T16:56:49.721ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
62262026-03-03T16:56:49.721ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
62272026-03-03T16:56:49.721ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
62282026-03-03T16:56:49.721ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
62292026-03-03T16:56:49.722ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 20 table_name = fields_string
62302026-03-03T16:56:49.724ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
62312026-03-03T16:56:49.724ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62322026-03-03T16:56:49.725ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
62332026-03-03T16:56:49.725ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
62342026-03-03T16:56:49.725ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
62352026-03-03T16:56:49.726ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
62362026-03-03T16:56:49.730ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
62372026-03-03T16:56:49.734ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
62382026-03-03T16:56:49.734ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
62392026-03-03T16:56:49.734ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
62402026-03-03T16:56:49.734ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_u16
62412026-03-03T16:56:49.734ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
62422026-03-03T16:56:49.734ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
62432026-03-03T16:56:49.734ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
62442026-03-03T16:56:49.734ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
62452026-03-03T16:56:49.734ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
62462026-03-03T16:56:49.734ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
62472026-03-03T16:56:49.734ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
62482026-03-03T16:56:49.734ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
62492026-03-03T16:56:49.736ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62502026-03-03T16:56:49.736ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
62512026-03-03T16:56:49.736ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
62522026-03-03T16:56:49.736ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
62532026-03-03T16:56:49.737ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_uuid
62542026-03-03T16:56:49.737ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
62552026-03-03T16:56:49.738ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
62562026-03-03T16:56:49.740ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
62572026-03-03T16:56:49.740ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62582026-03-03T16:56:49.740ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62592026-03-03T16:56:49.740ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62602026-03-03T16:56:49.740ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62612026-03-03T16:56:49.740ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62622026-03-03T16:56:49.740ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62632026-03-03T16:56:49.747ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = measurements_histogramu64
62642026-03-03T16:56:49.748ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
62652026-03-03T16:56:49.748ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
62662026-03-03T16:56:49.748ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
62672026-03-03T16:56:49.748ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
62682026-03-03T16:56:49.749ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62692026-03-03T16:56:49.761ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62702026-03-03T16:56:49.761ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62712026-03-03T16:56:49.761ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62722026-03-03T16:56:49.762ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62732026-03-03T16:56:49.768ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62742026-03-03T16:56:49.768ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62752026-03-03T16:56:49.768ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62762026-03-03T16:56:49.768ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62772026-03-03T16:56:49.769ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62782026-03-03T16:56:49.770ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
62792026-03-03T16:56:49.770ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
62802026-03-03T16:56:49.771ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
62812026-03-03T16:56:49.774ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
62822026-03-03T16:56:49.774ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62832026-03-03T16:56:49.774ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62842026-03-03T16:56:49.774ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62852026-03-03T16:56:49.774ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62862026-03-03T16:56:49.774ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62872026-03-03T16:56:49.776ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62882026-03-03T16:56:49.776ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62892026-03-03T16:56:49.776ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62902026-03-03T16:56:49.776ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62912026-03-03T16:56:49.776ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62922026-03-03T16:56:49.776ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62932026-03-03T16:56:49.801ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62942026-03-03T16:56:49.805ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62952026-03-03T16:56:49.808ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
62962026-03-03T16:56:49.819ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:49.679620269' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
62972026-03-03T16:56:49.838ZINFOtest_metrics (dropshot_external): request completed latency_us = 157506 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e47114f7-b143-4bed-906e-3af14356880f response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.679620269Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
62982026-03-03T16:56:49.838ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
62992026-03-03T16:56:49.838ZDEBGtest_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63002026-03-03T16:56:49.838ZINFOtest_metrics (external client test context): client received response status = 200
63012026-03-03T16:56:49.847ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63022026-03-03T16:56:49.849ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
63032026-03-03T16:56:49.849ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
63042026-03-03T16:56:49.849ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
63052026-03-03T16:56:49.849ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
63062026-03-03T16:56:49.849ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
63072026-03-03T16:56:49.849ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
63082026-03-03T16:56:49.849ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63092026-03-03T16:56:49.849ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
63102026-03-03T16:56:49.849ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = f99f1c9b-55c7-42da-912b-5c54ed0e3550 uri = /913233fe-92a8-4635-9572-183f495429c4
63112026-03-03T16:56:49.849ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63122026-03-03T16:56:49.849ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63132026-03-03T16:56:49.849ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63142026-03-03T16:56:49.849ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63152026-03-03T16:56:49.849ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63162026-03-03T16:56:49.865ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 19838 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = f99f1c9b-55c7-42da-912b-5c54ed0e3550 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
63172026-03-03T16:56:49.866ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
63182026-03-03T16:56:49.873ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
63192026-03-03T16:56:49.875ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
63202026-03-03T16:56:49.875ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
63212026-03-03T16:56:49.875ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
63222026-03-03T16:56:49.875ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
63232026-03-03T16:56:49.875ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
63242026-03-03T16:56:49.875ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
63252026-03-03T16:56:49.875ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63262026-03-03T16:56:49.875ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
63272026-03-03T16:56:49.879ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
63282026-03-03T16:56:49.881ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63292026-03-03T16:56:49.883ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63302026-03-03T16:56:49.883ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63312026-03-03T16:56:49.883ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 20 table_name = fields_string
63322026-03-03T16:56:49.883ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
63332026-03-03T16:56:49.884ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
63342026-03-03T16:56:49.884ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
63352026-03-03T16:56:49.884ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63362026-03-03T16:56:49.884ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63372026-03-03T16:56:49.885ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63382026-03-03T16:56:49.887ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_u16
63392026-03-03T16:56:49.887ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
63402026-03-03T16:56:49.889ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_uuid
63412026-03-03T16:56:49.889ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
63422026-03-03T16:56:49.895ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = measurements_histogramu64
63432026-03-03T16:56:49.895ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63442026-03-03T16:56:49.895ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63452026-03-03T16:56:49.896ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
63462026-03-03T16:56:49.898ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
63472026-03-03T16:56:49.898ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
63482026-03-03T16:56:49.898ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63492026-03-03T16:56:49.898ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63502026-03-03T16:56:49.898ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63512026-03-03T16:56:49.901ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
63522026-03-03T16:56:49.901ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
63532026-03-03T16:56:49.901ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
63542026-03-03T16:56:49.904ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
63552026-03-03T16:56:49.904ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63562026-03-03T16:56:49.904ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63572026-03-03T16:56:49.904ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63582026-03-03T16:56:49.905ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
63592026-03-03T16:56:49.905ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63602026-03-03T16:56:49.906ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
63612026-03-03T16:56:49.906ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
63622026-03-03T16:56:49.906ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63632026-03-03T16:56:49.906ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63642026-03-03T16:56:49.907ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63652026-03-03T16:56:49.908ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
63662026-03-03T16:56:49.908ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
63672026-03-03T16:56:49.908ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
63682026-03-03T16:56:49.909ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
63692026-03-03T16:56:49.910ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
63702026-03-03T16:56:49.912ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
63712026-03-03T16:56:49.912ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63722026-03-03T16:56:49.912ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63732026-03-03T16:56:49.912ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63742026-03-03T16:56:49.912ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63752026-03-03T16:56:49.912ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63762026-03-03T16:56:49.912ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63772026-03-03T16:56:49.914ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63782026-03-03T16:56:49.917ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63792026-03-03T16:56:49.919ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63802026-03-03T16:56:49.919ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63812026-03-03T16:56:49.919ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63822026-03-03T16:56:49.919ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63832026-03-03T16:56:49.919ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63842026-03-03T16:56:49.919ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63852026-03-03T16:56:49.919ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63862026-03-03T16:56:49.920ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63872026-03-03T16:56:49.922ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63882026-03-03T16:56:49.922ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63892026-03-03T16:56:49.922ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63902026-03-03T16:56:49.922ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63912026-03-03T16:56:49.924ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63922026-03-03T16:56:49.926ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63932026-03-03T16:56:49.926ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63942026-03-03T16:56:49.926ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63952026-03-03T16:56:49.926ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63962026-03-03T16:56:49.926ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63972026-03-03T16:56:49.926ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63982026-03-03T16:56:49.934ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
63992026-03-03T16:56:49.934ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64002026-03-03T16:56:49.936ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
64012026-03-03T16:56:49.939ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
64022026-03-03T16:56:49.940ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64032026-03-03T16:56:49.941ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:49.844699951' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
64042026-03-03T16:56:49.943ZINFOtest_metrics (dropshot_external): request completed latency_us = 98323 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 215334da-a036-4572-9107-7fbed4e8c254 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.844699951Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64052026-03-03T16:56:49.945ZINFOtest_metrics (external client test context): client received response status = 200
64062026-03-03T16:56:49.945ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64072026-03-03T16:56:49.945ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
64082026-03-03T16:56:49.945ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
64092026-03-03T16:56:49.945ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
64102026-03-03T16:56:49.945ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
64112026-03-03T16:56:49.945ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
64122026-03-03T16:56:49.945ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
64132026-03-03T16:56:49.945ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64142026-03-03T16:56:49.945ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
64152026-03-03T16:56:49.945ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 060255a8-d3ff-4fba-bca3-2e7edf1f49f1 uri = /913233fe-92a8-4635-9572-183f495429c4
64162026-03-03T16:56:49.945ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64172026-03-03T16:56:49.945ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64182026-03-03T16:56:49.945ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64192026-03-03T16:56:49.945ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64202026-03-03T16:56:49.945ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64212026-03-03T16:56:49.950ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5645 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 060255a8-d3ff-4fba-bca3-2e7edf1f49f1 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
64222026-03-03T16:56:49.950ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
64232026-03-03T16:56:49.957ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
64242026-03-03T16:56:49.957ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
64252026-03-03T16:56:49.957ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
64262026-03-03T16:56:49.957ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
64272026-03-03T16:56:49.957ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
64282026-03-03T16:56:49.957ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
64292026-03-03T16:56:49.957ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
64302026-03-03T16:56:49.958ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64312026-03-03T16:56:49.958ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
64322026-03-03T16:56:49.962ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
64332026-03-03T16:56:49.962ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64342026-03-03T16:56:49.962ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64352026-03-03T16:56:49.962ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64362026-03-03T16:56:49.965ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 20 table_name = fields_string
64372026-03-03T16:56:49.965ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
64382026-03-03T16:56:49.966ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_u16
64392026-03-03T16:56:49.966ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
64402026-03-03T16:56:49.970ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_uuid
64412026-03-03T16:56:49.971ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
64422026-03-03T16:56:49.976ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
64432026-03-03T16:56:49.976ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
64442026-03-03T16:56:49.976ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64452026-03-03T16:56:49.976ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64462026-03-03T16:56:49.976ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64472026-03-03T16:56:49.978ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = measurements_histogramu64
64482026-03-03T16:56:49.978ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64492026-03-03T16:56:49.978ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64502026-03-03T16:56:49.978ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
64512026-03-03T16:56:49.978ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
64522026-03-03T16:56:49.982ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
64532026-03-03T16:56:49.982ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64542026-03-03T16:56:49.982ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64552026-03-03T16:56:49.983ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64562026-03-03T16:56:49.984ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
64572026-03-03T16:56:49.984ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
64582026-03-03T16:56:49.988ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
64592026-03-03T16:56:49.989ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64602026-03-03T16:56:49.989ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
64612026-03-03T16:56:49.990ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
64622026-03-03T16:56:49.990ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64632026-03-03T16:56:49.990ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64642026-03-03T16:56:49.991ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64652026-03-03T16:56:49.996ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
64662026-03-03T16:56:49.996ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
64672026-03-03T16:56:49.996ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64682026-03-03T16:56:49.996ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64692026-03-03T16:56:49.997ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64702026-03-03T16:56:49.998ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
64712026-03-03T16:56:49.999ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
64722026-03-03T16:56:49.999ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
64732026-03-03T16:56:49.999ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
64742026-03-03T16:56:50.002ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
64752026-03-03T16:56:50.003ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
64762026-03-03T16:56:50.003ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64772026-03-03T16:56:50.003ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64782026-03-03T16:56:50.003ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64792026-03-03T16:56:50.003ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64802026-03-03T16:56:50.003ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64812026-03-03T16:56:50.003ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64822026-03-03T16:56:50.006ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64832026-03-03T16:56:50.008ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64842026-03-03T16:56:50.009ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64852026-03-03T16:56:50.009ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64862026-03-03T16:56:50.009ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64872026-03-03T16:56:50.011ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64882026-03-03T16:56:50.012ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64892026-03-03T16:56:50.012ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64902026-03-03T16:56:50.012ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64912026-03-03T16:56:50.012ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64922026-03-03T16:56:50.014ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64932026-03-03T16:56:50.014ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64942026-03-03T16:56:50.014ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64952026-03-03T16:56:50.015ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64962026-03-03T16:56:50.017ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64972026-03-03T16:56:50.019ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64982026-03-03T16:56:50.019ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
64992026-03-03T16:56:50.019ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
65002026-03-03T16:56:50.021ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
65012026-03-03T16:56:50.021ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
65022026-03-03T16:56:50.021ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
65032026-03-03T16:56:50.022ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
65042026-03-03T16:56:50.026ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
65052026-03-03T16:56:50.030ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
65062026-03-03T16:56:50.042ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:49.944127009' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
65072026-03-03T16:56:50.042ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
65082026-03-03T16:56:50.042ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65092026-03-03T16:56:50.045ZINFOtest_metrics (dropshot_external): request completed latency_us = 100658 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e36938cd-a74c-43c4-8903-3485902232f8 response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:49.944127009Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
65102026-03-03T16:56:50.046ZINFOtest_metrics (external client test context): client received response status = 200
65112026-03-03T16:56:50.046ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65122026-03-03T16:56:50.046ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
65132026-03-03T16:56:50.046ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
65142026-03-03T16:56:50.046ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
65152026-03-03T16:56:50.046ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
65162026-03-03T16:56:50.046ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
65172026-03-03T16:56:50.047ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
65182026-03-03T16:56:50.047ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65192026-03-03T16:56:50.047ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1 version = 2026021900.0.0
65202026-03-03T16:56:50.047ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 732910f0-169f-4b6c-bdf2-b06cbb3b1966 uri = /913233fe-92a8-4635-9572-183f495429c4
65212026-03-03T16:56:50.048ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65222026-03-03T16:56:50.048ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65232026-03-03T16:56:50.048ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65242026-03-03T16:56:50.048ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65252026-03-03T16:56:50.049ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65262026-03-03T16:56:50.054ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6217 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 732910f0-169f-4b6c-bdf2-b06cbb3b1966 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
65272026-03-03T16:56:50.054ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
65282026-03-03T16:56:50.059ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
65292026-03-03T16:56:50.059ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
65302026-03-03T16:56:50.059ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
65312026-03-03T16:56:50.059ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
65322026-03-03T16:56:50.059ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
65332026-03-03T16:56:50.059ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
65342026-03-03T16:56:50.059ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
65352026-03-03T16:56:50.059ZDEBGtest_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65362026-03-03T16:56:50.060ZDEBGtest_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
65372026-03-03T16:56:50.063ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
65382026-03-03T16:56:50.066ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65392026-03-03T16:56:50.066ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65402026-03-03T16:56:50.066ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65412026-03-03T16:56:50.070ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
65422026-03-03T16:56:50.070ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
65432026-03-03T16:56:50.070ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65442026-03-03T16:56:50.070ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65452026-03-03T16:56:50.071ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65462026-03-03T16:56:50.072ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 20 table_name = fields_string
65472026-03-03T16:56:50.072ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
65482026-03-03T16:56:50.074ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
65492026-03-03T16:56:50.074ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65502026-03-03T16:56:50.074ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65512026-03-03T16:56:50.074ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65522026-03-03T16:56:50.082ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
65532026-03-03T16:56:50.082ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
65542026-03-03T16:56:50.082ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65552026-03-03T16:56:50.082ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65562026-03-03T16:56:50.082ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65572026-03-03T16:56:50.082ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_u16
65582026-03-03T16:56:50.082ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
65592026-03-03T16:56:50.082ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
65602026-03-03T16:56:50.082ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
65612026-03-03T16:56:50.082ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65622026-03-03T16:56:50.082ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65632026-03-03T16:56:50.082ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65642026-03-03T16:56:50.082ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = fields_uuid
65652026-03-03T16:56:50.082ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
65662026-03-03T16:56:50.083ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
65672026-03-03T16:56:50.083ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
65682026-03-03T16:56:50.083ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
65692026-03-03T16:56:50.083ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
65702026-03-03T16:56:50.086ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
65712026-03-03T16:56:50.087ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
65722026-03-03T16:56:50.087ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65732026-03-03T16:56:50.087ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65742026-03-03T16:56:50.087ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65752026-03-03T16:56:50.087ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65762026-03-03T16:56:50.087ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65772026-03-03T16:56:50.087ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65782026-03-03T16:56:50.089ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 10 table_name = measurements_histogramu64
65792026-03-03T16:56:50.089ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65802026-03-03T16:56:50.089ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65812026-03-03T16:56:50.089ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
65822026-03-03T16:56:50.089ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
65832026-03-03T16:56:50.090ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
65842026-03-03T16:56:50.090ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
65852026-03-03T16:56:50.091ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65862026-03-03T16:56:50.091ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65872026-03-03T16:56:50.091ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65882026-03-03T16:56:50.091ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65892026-03-03T16:56:50.093ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65902026-03-03T16:56:50.095ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65912026-03-03T16:56:50.096ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65922026-03-03T16:56:50.096ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65932026-03-03T16:56:50.096ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65942026-03-03T16:56:50.096ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65952026-03-03T16:56:50.096ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65962026-03-03T16:56:50.096ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
65972026-03-03T16:56:50.096ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65982026-03-03T16:56:50.096ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
65992026-03-03T16:56:50.097ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
66002026-03-03T16:56:50.097ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
66012026-03-03T16:56:50.097ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
66022026-03-03T16:56:50.103ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
66032026-03-03T16:56:50.105ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
66042026-03-03T16:56:50.106ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
66052026-03-03T16:56:50.110ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:50.046584352' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
66062026-03-03T16:56:50.114ZINFOtest_metrics (dropshot_external): request completed latency_us = 67342 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 02ae2251-ae85-4ee9-a91a-0507bf37a03f response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.046584352Z&order=descending&limit=1
66072026-03-03T16:56:50.115ZINFOtest_metrics (external client test context): client received response status = 200
66082026-03-03T16:56:50.115ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66092026-03-03T16:56:50.115ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
66102026-03-03T16:56:50.115ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
66112026-03-03T16:56:50.115ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
66122026-03-03T16:56:50.115ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
66132026-03-03T16:56:50.115ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
66142026-03-03T16:56:50.115ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
66152026-03-03T16:56:50.116ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66162026-03-03T16:56:50.116ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1 version = 2026021900.0.0
66172026-03-03T16:56:50.116ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 10c13080-1ee1-4c93-bc30-8825b57436af uri = /913233fe-92a8-4635-9572-183f495429c4
66182026-03-03T16:56:50.117ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66192026-03-03T16:56:50.117ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66202026-03-03T16:56:50.117ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66212026-03-03T16:56:50.117ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66222026-03-03T16:56:50.117ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66232026-03-03T16:56:50.121ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5715 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 10c13080-1ee1-4c93-bc30-8825b57436af response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
66242026-03-03T16:56:50.121ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
66252026-03-03T16:56:50.127ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
66262026-03-03T16:56:50.127ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
66272026-03-03T16:56:50.127ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
66282026-03-03T16:56:50.130ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
66292026-03-03T16:56:50.131ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
66302026-03-03T16:56:50.131ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
66312026-03-03T16:56:50.131ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
66322026-03-03T16:56:50.132ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66332026-03-03T16:56:50.132ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66342026-03-03T16:56:50.132ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66352026-03-03T16:56:50.132ZDEBGtest_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66362026-03-03T16:56:50.132ZDEBGtest_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
66372026-03-03T16:56:50.137ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
66382026-03-03T16:56:50.138ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
66392026-03-03T16:56:50.138ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
66402026-03-03T16:56:50.139ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66412026-03-03T16:56:50.139ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66422026-03-03T16:56:50.139ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66432026-03-03T16:56:50.140ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 22 table_name = fields_string
66442026-03-03T16:56:50.140ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
66452026-03-03T16:56:50.141ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
66462026-03-03T16:56:50.141ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66472026-03-03T16:56:50.141ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66482026-03-03T16:56:50.142ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66492026-03-03T16:56:50.142ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 11 table_name = fields_u16
66502026-03-03T16:56:50.142ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
66512026-03-03T16:56:50.144ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
66522026-03-03T16:56:50.146ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
66532026-03-03T16:56:50.146ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66542026-03-03T16:56:50.146ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66552026-03-03T16:56:50.146ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66562026-03-03T16:56:50.147ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 11 table_name = fields_uuid
66572026-03-03T16:56:50.147ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 11 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
66582026-03-03T16:56:50.147ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
66592026-03-03T16:56:50.147ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66602026-03-03T16:56:50.148ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
66612026-03-03T16:56:50.151ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
66622026-03-03T16:56:50.151ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66632026-03-03T16:56:50.151ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66642026-03-03T16:56:50.151ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66652026-03-03T16:56:50.151ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
66662026-03-03T16:56:50.151ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
66672026-03-03T16:56:50.151ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
66682026-03-03T16:56:50.151ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
66692026-03-03T16:56:50.152ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 11 table_name = measurements_histogramu64
66702026-03-03T16:56:50.152ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66712026-03-03T16:56:50.152ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66722026-03-03T16:56:50.152ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
66732026-03-03T16:56:50.154ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
66742026-03-03T16:56:50.156ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
66752026-03-03T16:56:50.156ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
66762026-03-03T16:56:50.157ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
66772026-03-03T16:56:50.157ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66782026-03-03T16:56:50.159ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
66792026-03-03T16:56:50.161ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
66802026-03-03T16:56:50.162ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66812026-03-03T16:56:50.162ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66822026-03-03T16:56:50.162ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66832026-03-03T16:56:50.162ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66842026-03-03T16:56:50.162ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66852026-03-03T16:56:50.162ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66862026-03-03T16:56:50.165ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66872026-03-03T16:56:50.165ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66882026-03-03T16:56:50.165ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66892026-03-03T16:56:50.165ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66902026-03-03T16:56:50.167ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66912026-03-03T16:56:50.169ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66922026-03-03T16:56:50.169ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66932026-03-03T16:56:50.169ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66942026-03-03T16:56:50.169ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66952026-03-03T16:56:50.169ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66962026-03-03T16:56:50.169ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66972026-03-03T16:56:50.171ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66982026-03-03T16:56:50.171ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
66992026-03-03T16:56:50.171ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
67002026-03-03T16:56:50.172ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
67012026-03-03T16:56:50.183ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
67022026-03-03T16:56:50.184ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
67032026-03-03T16:56:50.187ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
67042026-03-03T16:56:50.191ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:50.115223981' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
67052026-03-03T16:56:50.194ZINFOtest_metrics (dropshot_external): request completed latency_us = 78379 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ba24fbfc-c97a-475e-b736-7e9cb90b4da5 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.115223981Z&order=descending&limit=1
67062026-03-03T16:56:50.194ZINFOtest_metrics (external client test context): client received response status = 200
67072026-03-03T16:56:50.195ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67082026-03-03T16:56:50.195ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
67092026-03-03T16:56:50.195ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
67102026-03-03T16:56:50.195ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
67112026-03-03T16:56:50.195ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
67122026-03-03T16:56:50.195ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
67132026-03-03T16:56:50.195ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
67142026-03-03T16:56:50.195ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67152026-03-03T16:56:50.195ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1 version = 2026021900.0.0
67162026-03-03T16:56:50.195ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = eaf26197-b6b2-4b5e-8d7f-ec98494ead98 uri = /913233fe-92a8-4635-9572-183f495429c4
67172026-03-03T16:56:50.195ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67182026-03-03T16:56:50.196ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67192026-03-03T16:56:50.196ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67202026-03-03T16:56:50.196ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67212026-03-03T16:56:50.196ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67222026-03-03T16:56:50.201ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5708 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = eaf26197-b6b2-4b5e-8d7f-ec98494ead98 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
67232026-03-03T16:56:50.201ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
67242026-03-03T16:56:50.207ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
67252026-03-03T16:56:50.207ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
67262026-03-03T16:56:50.207ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
67272026-03-03T16:56:50.207ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
67282026-03-03T16:56:50.207ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
67292026-03-03T16:56:50.207ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
67302026-03-03T16:56:50.207ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
67312026-03-03T16:56:50.207ZDEBGtest_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
67322026-03-03T16:56:50.207ZDEBGtest_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
67332026-03-03T16:56:50.212ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
67342026-03-03T16:56:50.214ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67352026-03-03T16:56:50.214ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67362026-03-03T16:56:50.214ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67372026-03-03T16:56:50.215ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 22 table_name = fields_string
67382026-03-03T16:56:50.216ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
67392026-03-03T16:56:50.217ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
67402026-03-03T16:56:50.217ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
67412026-03-03T16:56:50.217ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67422026-03-03T16:56:50.217ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67432026-03-03T16:56:50.217ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67442026-03-03T16:56:50.218ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 11 table_name = fields_u16
67452026-03-03T16:56:50.220ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
67462026-03-03T16:56:50.220ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
67472026-03-03T16:56:50.220ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67482026-03-03T16:56:50.220ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67492026-03-03T16:56:50.220ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67502026-03-03T16:56:50.221ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
67512026-03-03T16:56:50.224ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
67522026-03-03T16:56:50.224ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67532026-03-03T16:56:50.225ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67542026-03-03T16:56:50.225ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67552026-03-03T16:56:50.225ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 11 table_name = fields_uuid
67562026-03-03T16:56:50.225ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 11 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
67572026-03-03T16:56:50.226ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
67582026-03-03T16:56:50.226ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
67592026-03-03T16:56:50.226ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67602026-03-03T16:56:50.226ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67612026-03-03T16:56:50.227ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67622026-03-03T16:56:50.227ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 11 table_name = measurements_histogramu64
67632026-03-03T16:56:50.229ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
67642026-03-03T16:56:50.231ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
67652026-03-03T16:56:50.231ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
67662026-03-03T16:56:50.231ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
67672026-03-03T16:56:50.231ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
67682026-03-03T16:56:50.231ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
67692026-03-03T16:56:50.231ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
67702026-03-03T16:56:50.231ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
67712026-03-03T16:56:50.231ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
67722026-03-03T16:56:50.233ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
67732026-03-03T16:56:50.233ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67742026-03-03T16:56:50.233ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67752026-03-03T16:56:50.233ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67762026-03-03T16:56:50.233ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67772026-03-03T16:56:50.233ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67782026-03-03T16:56:50.234ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67792026-03-03T16:56:50.236ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67802026-03-03T16:56:50.236ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67812026-03-03T16:56:50.236ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67822026-03-03T16:56:50.236ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67832026-03-03T16:56:50.237ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
67842026-03-03T16:56:50.237ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
67852026-03-03T16:56:50.240ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67862026-03-03T16:56:50.241ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67872026-03-03T16:56:50.243ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67882026-03-03T16:56:50.243ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67892026-03-03T16:56:50.243ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67902026-03-03T16:56:50.243ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67912026-03-03T16:56:50.243ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67922026-03-03T16:56:50.245ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
67932026-03-03T16:56:50.245ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
67942026-03-03T16:56:50.245ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67952026-03-03T16:56:50.245ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67962026-03-03T16:56:50.245ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67972026-03-03T16:56:50.246ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
67982026-03-03T16:56:50.247ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
67992026-03-03T16:56:50.247ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68002026-03-03T16:56:50.248ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
68012026-03-03T16:56:50.250ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
68022026-03-03T16:56:50.252ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
68032026-03-03T16:56:50.271ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:50.194634497' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
68042026-03-03T16:56:50.273ZINFOtest_metrics (dropshot_external): request completed latency_us = 78558 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b0a8deb5-5c83-484f-b325-c9599eda9696 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.194634497Z&order=descending&limit=1
68052026-03-03T16:56:50.274ZINFOtest_metrics (external client test context): client received response status = 200
68062026-03-03T16:56:50.274ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:40151/v1/projects
68072026-03-03T16:56:50.274ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f uri = /v1/projects
68082026-03-03T16:56:50.274ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f uri = /v1/projects version = 2026021900.0.0
68092026-03-03T16:56:50.274ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f uri = /v1/projects
68102026-03-03T16:56:50.274ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/projects
68112026-03-03T16:56:50.275ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68122026-03-03T16:56:50.275ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68132026-03-03T16:56:50.275ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68142026-03-03T16:56:50.277ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68152026-03-03T16:56:50.278ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68162026-03-03T16:56:50.278ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68172026-03-03T16:56:50.279ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
68182026-03-03T16:56:50.279ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
68192026-03-03T16:56:50.279ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68202026-03-03T16:56:50.279ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68212026-03-03T16:56:50.279ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68222026-03-03T16:56:50.281ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
68232026-03-03T16:56:50.281ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68242026-03-03T16:56:50.281ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68252026-03-03T16:56:50.281ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68262026-03-03T16:56:50.283ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
68272026-03-03T16:56:50.285ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
68282026-03-03T16:56:50.285ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68292026-03-03T16:56:50.285ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68302026-03-03T16:56:50.286ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68312026-03-03T16:56:50.287ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
68322026-03-03T16:56:50.287ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
68332026-03-03T16:56:50.287ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68342026-03-03T16:56:50.287ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68352026-03-03T16:56:50.288ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68362026-03-03T16:56:50.289ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
68372026-03-03T16:56:50.289ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
68382026-03-03T16:56:50.289ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
68392026-03-03T16:56:50.289ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
68402026-03-03T16:56:50.290ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
68412026-03-03T16:56:50.292ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
68422026-03-03T16:56:50.292ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f uri = /v1/projects
68432026-03-03T16:56:50.292ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68442026-03-03T16:56:50.292ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68452026-03-03T16:56:50.292ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68462026-03-03T16:56:50.292ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68472026-03-03T16:56:50.293ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68482026-03-03T16:56:50.295ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68492026-03-03T16:56:50.296ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68502026-03-03T16:56:50.296ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68512026-03-03T16:56:50.296ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68522026-03-03T16:56:50.297ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68532026-03-03T16:56:50.299ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68542026-03-03T16:56:50.299ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68552026-03-03T16:56:50.299ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68562026-03-03T16:56:50.299ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68572026-03-03T16:56:50.299ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68582026-03-03T16:56:50.301ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68592026-03-03T16:56:50.301ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68602026-03-03T16:56:50.301ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68612026-03-03T16:56:50.301ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68622026-03-03T16:56:50.303ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68632026-03-03T16:56:50.305ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
68642026-03-03T16:56:50.305ZINFOtest_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
68652026-03-03T16:56:50.305ZINFOtest_metrics (SagaExecutor): preparing saga saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create
68662026-03-03T16:56:50.305ZINFOtest_metrics (SEC): saga create dag = {"end_node":21,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[16,17,null],[17,18,null],[2,3,null],[18,19,null],[20,0,null],[19,21,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSubnetRouteId","name":"subnet_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet_route","label":"VpcCreateSubnetRoute","name":"route"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"001de000-5110-4000-8000-000000000000","lookup_type":{"ById":"001de000-5110-4000-8000-000000000000"},"parent":null},"project_create":{"description":"a pier","name":"p-1"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"project-create","start_node":20} saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
68672026-03-03T16:56:50.305ZINFOtest_metrics (SecStore): creating saga saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create
68682026-03-03T16:56:50.332ZINFOtest_metrics (SagaExecutor): starting saga saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create
68692026-03-03T16:56:50.332ZINFOtest_metrics (SEC): saga start saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
68702026-03-03T16:56:50.332ZDEBGtest_metrics (SEC): saga log event new_state = N020 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
68712026-03-03T16:56:50.332ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 20 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
68722026-03-03T16:56:50.339ZDEBGtest_metrics (SEC): saga log event new_state = N020 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
68732026-03-03T16:56:50.339ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 20 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
68742026-03-03T16:56:50.340ZDEBGtest_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
68752026-03-03T16:56:50.340ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
68762026-03-03T16:56:50.342ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68772026-03-03T16:56:50.342ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68782026-03-03T16:56:50.342ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68792026-03-03T16:56:50.342ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68802026-03-03T16:56:50.343ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68812026-03-03T16:56:50.345ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68822026-03-03T16:56:50.345ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68832026-03-03T16:56:50.345ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68842026-03-03T16:56:50.345ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68852026-03-03T16:56:50.347ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68862026-03-03T16:56:50.349ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68872026-03-03T16:56:50.349ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68882026-03-03T16:56:50.349ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68892026-03-03T16:56:50.350ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68902026-03-03T16:56:50.350ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
68912026-03-03T16:56:50.350ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68922026-03-03T16:56:50.355ZDEBGtest_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
68932026-03-03T16:56:50.355ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "name": String("p-1"), "time_created": String("2026-03-03T16:56:50.342549Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.342549Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}]) node_id = 0 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
68942026-03-03T16:56:50.356ZDEBGtest_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
68952026-03-03T16:56:50.356ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
68962026-03-03T16:56:50.358ZDEBGtest_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
68972026-03-03T16:56:50.358ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd7d:d5b2:24a7::/48"), "name": String("default")}}) node_id = 1 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
68982026-03-03T16:56:50.360ZDEBGtest_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
68992026-03-03T16:56:50.360ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69002026-03-03T16:56:50.361ZDEBGtest_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69012026-03-03T16:56:50.361ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69022026-03-03T16:56:50.362ZDEBGtest_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69032026-03-03T16:56:50.362ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69042026-03-03T16:56:50.364ZDEBGtest_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69052026-03-03T16:56:50.364ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("5b83d48c-0655-438b-87aa-fbaf0aadd439")) node_id = 3 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69062026-03-03T16:56:50.365ZDEBGtest_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69072026-03-03T16:56:50.365ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69082026-03-03T16:56:50.367ZDEBGtest_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69092026-03-03T16:56:50.367ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("b7b34caf-70bf-442a-8106-d354c3fece87")) node_id = 4 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69102026-03-03T16:56:50.368ZDEBGtest_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69112026-03-03T16:56:50.368ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69122026-03-03T16:56:50.375ZDEBGtest_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69132026-03-03T16:56:50.375ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("171c30f3-81e3-4206-8632-49483fec19be")) node_id = 5 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69142026-03-03T16:56:50.377ZDEBGtest_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69152026-03-03T16:56:50.377ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69162026-03-03T16:56:50.378ZDEBGtest_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69172026-03-03T16:56:50.378ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("30baf4c8-2182-4a1b-962f-4fca3206ec47")) node_id = 6 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69182026-03-03T16:56:50.379ZDEBGtest_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69192026-03-03T16:56:50.379ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69202026-03-03T16:56:50.381ZDEBGtest_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69212026-03-03T16:56:50.381ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("c281a52c-9039-482e-aa75-23b56e03c3b4")) node_id = 7 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69222026-03-03T16:56:50.382ZDEBGtest_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69232026-03-03T16:56:50.382ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69242026-03-03T16:56:50.383ZDEBGtest_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69252026-03-03T16:56:50.383ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("453a352b-10aa-4873-adc2-4d11e650f92f")) node_id = 8 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69262026-03-03T16:56:50.384ZDEBGtest_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69272026-03-03T16:56:50.384ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69282026-03-03T16:56:50.385ZDEBGtest_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69292026-03-03T16:56:50.385ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("87b75148-24ab-4643-8655-087620cab27b")) node_id = 9 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69302026-03-03T16:56:50.386ZDEBGtest_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69312026-03-03T16:56:50.386ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69322026-03-03T16:56:50.388ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69332026-03-03T16:56:50.388ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69342026-03-03T16:56:50.388ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69352026-03-03T16:56:50.388ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69362026-03-03T16:56:50.388ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69372026-03-03T16:56:50.390ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69382026-03-03T16:56:50.390ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69392026-03-03T16:56:50.390ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69402026-03-03T16:56:50.390ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69412026-03-03T16:56:50.392ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69422026-03-03T16:56:50.392ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69432026-03-03T16:56:50.392ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69442026-03-03T16:56:50.392ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69452026-03-03T16:56:50.394ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69462026-03-03T16:56:50.398ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69472026-03-03T16:56:50.399ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69482026-03-03T16:56:50.399ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69492026-03-03T16:56:50.399ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69502026-03-03T16:56:50.406ZDEBGtest_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69512026-03-03T16:56:50.406ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "name": String("default"), "time_created": String("2026-03-03T16:56:50.388047Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.388047Z")}, "ipv6_prefix": String("fd7d:d5b2:24a7::/48"), "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "subnet_gen": Number(1), "system_router_id": String("b7b34caf-70bf-442a-8106-d354c3fece87"), "vni": Number(1795622)}]) node_id = 10 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69522026-03-03T16:56:50.408ZDEBGtest_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69532026-03-03T16:56:50.408ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69542026-03-03T16:56:50.410ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69552026-03-03T16:56:50.410ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69562026-03-03T16:56:50.410ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69572026-03-03T16:56:50.410ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69582026-03-03T16:56:50.411ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69592026-03-03T16:56:50.412ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69602026-03-03T16:56:50.412ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69612026-03-03T16:56:50.412ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69622026-03-03T16:56:50.413ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69632026-03-03T16:56:50.423ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69642026-03-03T16:56:50.423ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69652026-03-03T16:56:50.423ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69662026-03-03T16:56:50.423ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69672026-03-03T16:56:50.425ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69682026-03-03T16:56:50.430ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69692026-03-03T16:56:50.430ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69702026-03-03T16:56:50.430ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69712026-03-03T16:56:50.430ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69722026-03-03T16:56:50.432ZDEBGtest_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69732026-03-03T16:56:50.433ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("b7b34caf-70bf-442a-8106-d354c3fece87"), "lookup_type": Object {"ById": String("b7b34caf-70bf-442a-8106-d354c3fece87")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}) node_id = 11 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69742026-03-03T16:56:50.434ZDEBGtest_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69752026-03-03T16:56:50.434ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69762026-03-03T16:56:50.436ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") }, key: b7b34caf-70bf-442a-8106-d354c3fece87, lookup_type: ById(b7b34caf-70bf-442a-8106-d354c3fece87) } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69772026-03-03T16:56:50.436ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69782026-03-03T16:56:50.436ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69792026-03-03T16:56:50.436ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69802026-03-03T16:56:50.437ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69812026-03-03T16:56:50.443ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69822026-03-03T16:56:50.443ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69832026-03-03T16:56:50.443ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69842026-03-03T16:56:50.443ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69852026-03-03T16:56:50.451ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
69862026-03-03T16:56:50.452ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
69872026-03-03T16:56:50.452ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69882026-03-03T16:56:50.452ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69892026-03-03T16:56:50.452ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69902026-03-03T16:56:50.455ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69912026-03-03T16:56:50.465ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69922026-03-03T16:56:50.470ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") }, key: b7b34caf-70bf-442a-8106-d354c3fece87, lookup_type: ById(b7b34caf-70bf-442a-8106-d354c3fece87) } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69932026-03-03T16:56:50.470ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69942026-03-03T16:56:50.470ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69952026-03-03T16:56:50.470ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69962026-03-03T16:56:50.499ZDEBGtest_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69972026-03-03T16:56:50.499ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
69982026-03-03T16:56:50.501ZDEBGtest_metrics (SEC): saga log event new_state = N013 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69992026-03-03T16:56:50.501ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
70002026-03-03T16:56:50.503ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") }, key: b7b34caf-70bf-442a-8106-d354c3fece87, lookup_type: ById(b7b34caf-70bf-442a-8106-d354c3fece87) } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70012026-03-03T16:56:50.503ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70022026-03-03T16:56:50.503ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70032026-03-03T16:56:50.503ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70042026-03-03T16:56:50.503ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70052026-03-03T16:56:50.504ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
70062026-03-03T16:56:50.505ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70072026-03-03T16:56:50.505ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70082026-03-03T16:56:50.505ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70092026-03-03T16:56:50.506ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70102026-03-03T16:56:50.507ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70112026-03-03T16:56:50.507ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70122026-03-03T16:56:50.507ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70132026-03-03T16:56:50.508ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70142026-03-03T16:56:50.510ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70152026-03-03T16:56:50.514ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") }, key: b7b34caf-70bf-442a-8106-d354c3fece87, lookup_type: ById(b7b34caf-70bf-442a-8106-d354c3fece87) } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70162026-03-03T16:56:50.514ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70172026-03-03T16:56:50.514ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70182026-03-03T16:56:50.515ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70192026-03-03T16:56:50.528ZDEBGtest_metrics (SEC): saga log event new_state = N013 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
70202026-03-03T16:56:50.528ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
70212026-03-03T16:56:50.530ZDEBGtest_metrics (SEC): saga log event new_state = N014 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
70222026-03-03T16:56:50.530ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
70232026-03-03T16:56:50.532ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70242026-03-03T16:56:50.532ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70252026-03-03T16:56:50.532ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70262026-03-03T16:56:50.532ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70272026-03-03T16:56:50.532ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70282026-03-03T16:56:50.534ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70292026-03-03T16:56:50.534ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70302026-03-03T16:56:50.534ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70312026-03-03T16:56:50.535ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70322026-03-03T16:56:50.536ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70332026-03-03T16:56:50.536ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70342026-03-03T16:56:50.536ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70352026-03-03T16:56:50.537ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70362026-03-03T16:56:50.541ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70372026-03-03T16:56:50.543ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70382026-03-03T16:56:50.546ZDEBGtest_metrics (SEC): saga log event new_state = N014 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
70392026-03-03T16:56:50.546ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("453a352b-10aa-4873-adc2-4d11e650f92f"), "lookup_type": Object {"ById": String("453a352b-10aa-4873-adc2-4d11e650f92f")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("453a352b-10aa-4873-adc2-4d11e650f92f"), "name": String("default"), "time_created": String("2026-03-03T16:56:50.532233Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.532233Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd7d:d5b2:24a7::/64"), "rcgen": Number(1), "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}]) node_id = 14 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
70402026-03-03T16:56:50.549ZDEBGtest_metrics (SEC): saga log event new_state = N015 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
70412026-03-03T16:56:50.549ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
70422026-03-03T16:56:50.551ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") }, key: b7b34caf-70bf-442a-8106-d354c3fece87, lookup_type: ById(b7b34caf-70bf-442a-8106-d354c3fece87) } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70432026-03-03T16:56:50.551ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70442026-03-03T16:56:50.551ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70452026-03-03T16:56:50.551ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70462026-03-03T16:56:50.551ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70472026-03-03T16:56:50.553ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
70482026-03-03T16:56:50.553ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
70492026-03-03T16:56:50.553ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70502026-03-03T16:56:50.553ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70512026-03-03T16:56:50.553ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70522026-03-03T16:56:50.554ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70532026-03-03T16:56:50.555ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70542026-03-03T16:56:50.555ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70552026-03-03T16:56:50.555ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70562026-03-03T16:56:50.556ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70572026-03-03T16:56:50.557ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70582026-03-03T16:56:50.562ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") }, key: b7b34caf-70bf-442a-8106-d354c3fece87, lookup_type: ById(b7b34caf-70bf-442a-8106-d354c3fece87) } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70592026-03-03T16:56:50.562ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70602026-03-03T16:56:50.562ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70612026-03-03T16:56:50.563ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70622026-03-03T16:56:50.566ZDEBGtest_metrics (SEC): saga log event new_state = N015 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
70632026-03-03T16:56:50.566ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("c281a52c-9039-482e-aa75-23b56e03c3b4"), "lookup_type": Object {"ById": String("453a352b-10aa-4873-adc2-4d11e650f92f")}, "parent": Object {"key": String("b7b34caf-70bf-442a-8106-d354c3fece87"), "lookup_type": Object {"ById": String("b7b34caf-70bf-442a-8106-d354c3fece87")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}) node_id = 15 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
70642026-03-03T16:56:50.567ZDEBGtest_metrics (SEC): saga log event new_state = N016 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
70652026-03-03T16:56:50.567ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
70662026-03-03T16:56:50.569ZDEBGtest_metrics (nexus): default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: f53da394-128b-48df-ab46-9ace388b1578, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2026-03-03T16:56:50.569747Z, time_modified: 2026-03-03T16:56:50.569747Z, time_deleted: None }, vpc_id: 5b83d48c-0655-438b-87aa-fbaf0aadd439, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: a162907e-f8a8-41de-820c-cd2a1ff0a2cf, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2026-03-03T16:56:50.569770Z, time_modified: 2026-03-03T16:56:50.569770Z, time_deleted: None }, vpc_id: 5b83d48c-0655-438b-87aa-fbaf0aadd439, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 01c9da81-4447-48c1-bdd3-5621319463ac, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2026-03-03T16:56:50.569779Z, time_modified: 2026-03-03T16:56:50.569779Z, time_deleted: None }, vpc_id: 5b83d48c-0655-438b-87aa-fbaf0aadd439, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp(None))]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
70672026-03-03T16:56:50.569ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70682026-03-03T16:56:50.569ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70692026-03-03T16:56:50.569ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70702026-03-03T16:56:50.569ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70712026-03-03T16:56:50.570ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70722026-03-03T16:56:50.572ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70732026-03-03T16:56:50.572ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70742026-03-03T16:56:50.576ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70752026-03-03T16:56:50.576ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70762026-03-03T16:56:50.576ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70772026-03-03T16:56:50.576ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70782026-03-03T16:56:50.576ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70792026-03-03T16:56:50.576ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70802026-03-03T16:56:50.577ZINFOtest_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
70812026-03-03T16:56:50.577ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
70822026-03-03T16:56:50.577ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70832026-03-03T16:56:50.582ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70842026-03-03T16:56:50.582ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70852026-03-03T16:56:50.582ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70862026-03-03T16:56:50.582ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70872026-03-03T16:56:50.583ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 5095b86a-a58b-4e62-86b8-ef36939e5b76 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
70882026-03-03T16:56:50.583ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 5095b86a-a58b-4e62-86b8-ef36939e5b76 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
70892026-03-03T16:56:50.583ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 5095b86a-a58b-4e62-86b8-ef36939e5b76 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
70902026-03-03T16:56:50.583ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 5095b86a-a58b-4e62-86b8-ef36939e5b76 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
70912026-03-03T16:56:50.584ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 5095b86a-a58b-4e62-86b8-ef36939e5b76 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
70922026-03-03T16:56:50.584ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
70932026-03-03T16:56:50.584ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
70942026-03-03T16:56:50.586ZINFOtest_metrics (dropshot_internal): request completed latency_us = 2829 local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 5095b86a-a58b-4e62-86b8-ef36939e5b76 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
70952026-03-03T16:56:50.586ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
70962026-03-03T16:56:50.587ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
70972026-03-03T16:56:50.587ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
70982026-03-03T16:56:50.587ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
70992026-03-03T16:56:50.588ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "5095b86a-a58b-4e62-86b8-ef36939e5b76", "content-length": "405", "date": "Tue, 03 Mar 2026 16:56:50 GMT"} })
71002026-03-03T16:56:50.588ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
71012026-03-03T16:56:50.588ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84a31b3e-0b87-4494-b4ad-4fb3ddc981be uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
71022026-03-03T16:56:50.588ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84a31b3e-0b87-4494-b4ad-4fb3ddc981be uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
71032026-03-03T16:56:50.588ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84a31b3e-0b87-4494-b4ad-4fb3ddc981be resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
71042026-03-03T16:56:50.588ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84a31b3e-0b87-4494-b4ad-4fb3ddc981be roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
71052026-03-03T16:56:50.588ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84a31b3e-0b87-4494-b4ad-4fb3ddc981be resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
71062026-03-03T16:56:50.593ZINFOtest_metrics (dropshot_internal): request completed latency_us = 4552 local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 84a31b3e-0b87-4494-b4ad-4fb3ddc981be response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
71072026-03-03T16:56:50.593ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "84a31b3e-0b87-4494-b4ad-4fb3ddc981be", "content-length": "29", "date": "Tue, 03 Mar 2026 16:56:50 GMT"} })
71082026-03-03T16:56:50.593ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
71092026-03-03T16:56:50.593ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
71102026-03-03T16:56:50.593ZINFOtest_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
71112026-03-03T16:56:50.595ZDEBGtest_metrics (SEC): saga log event new_state = N016 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
71122026-03-03T16:56:50.595ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("f53da394-128b-48df-ab46-9ace388b1578"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T16:56:50.569747Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.569747Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("a162907e-f8a8-41de-820c-cd2a1ff0a2cf"), "name": String("allow-ssh"), "time_created": String("2026-03-03T16:56:50.569770Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.569770Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("01c9da81-4447-48c1-bdd3-5621319463ac"), "name": String("allow-icmp"), "time_created": String("2026-03-03T16:56:50.569779Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.569779Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}]) node_id = 16 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
71132026-03-03T16:56:50.597ZDEBGtest_metrics (SEC): saga log event new_state = N017 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
71142026-03-03T16:56:50.597ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
71152026-03-03T16:56:50.600ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71162026-03-03T16:56:50.600ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71172026-03-03T16:56:50.600ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71182026-03-03T16:56:50.600ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71192026-03-03T16:56:50.600ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71202026-03-03T16:56:50.602ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71212026-03-03T16:56:50.602ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71222026-03-03T16:56:50.602ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71232026-03-03T16:56:50.603ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71242026-03-03T16:56:50.605ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71252026-03-03T16:56:50.605ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71262026-03-03T16:56:50.605ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71272026-03-03T16:56:50.605ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71282026-03-03T16:56:50.607ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71292026-03-03T16:56:50.611ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71302026-03-03T16:56:50.611ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71312026-03-03T16:56:50.611ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71322026-03-03T16:56:50.612ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71332026-03-03T16:56:50.613ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71342026-03-03T16:56:50.613ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71352026-03-03T16:56:50.614ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71362026-03-03T16:56:50.615ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71372026-03-03T16:56:50.615ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71382026-03-03T16:56:50.616ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71392026-03-03T16:56:50.618ZWARNtest_metrics (SagaExecutor): Default ip pool lookup failed: Invalid Request: Multiple default unicast IP pools exist with different IP versions. Please specify ip_version (v4 or v6) or provide an explicit pool.. Default gateway has no ip pool association authenticated = true saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71402026-03-03T16:56:50.618ZDEBGtest_metrics (SEC): saga log event new_state = N017 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
71412026-03-03T16:56:50.618ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("87b75148-24ab-4643-8655-087620cab27b"), "lookup_type": Object {"ById": String("87b75148-24ab-4643-8655-087620cab27b")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}) node_id = 17 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
71422026-03-03T16:56:50.621ZDEBGtest_metrics (SEC): saga log event new_state = N018 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
71432026-03-03T16:56:50.621ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 18 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
71442026-03-03T16:56:50.622ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71452026-03-03T16:56:50.622ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71462026-03-03T16:56:50.626ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71472026-03-03T16:56:50.633ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71482026-03-03T16:56:50.633ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71492026-03-03T16:56:50.633ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71502026-03-03T16:56:50.633ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71512026-03-03T16:56:50.633ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71522026-03-03T16:56:50.633ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71532026-03-03T16:56:50.634ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71542026-03-03T16:56:50.634ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71552026-03-03T16:56:50.634ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71562026-03-03T16:56:50.634ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71572026-03-03T16:56:50.635ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71582026-03-03T16:56:50.637ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71592026-03-03T16:56:50.637ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71602026-03-03T16:56:50.637ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71612026-03-03T16:56:50.638ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71622026-03-03T16:56:50.639ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71632026-03-03T16:56:50.639ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71642026-03-03T16:56:50.639ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71652026-03-03T16:56:50.640ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71662026-03-03T16:56:50.641ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71672026-03-03T16:56:50.649ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71682026-03-03T16:56:50.649ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71692026-03-03T16:56:50.649ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71702026-03-03T16:56:50.649ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71712026-03-03T16:56:50.649ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71722026-03-03T16:56:50.654ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71732026-03-03T16:56:50.655ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
71742026-03-03T16:56:50.655ZDEBGtest_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
71752026-03-03T16:56:50.656ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71762026-03-03T16:56:50.656ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71772026-03-03T16:56:50.656ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71782026-03-03T16:56:50.657ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71792026-03-03T16:56:50.660ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71802026-03-03T16:56:50.660ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71812026-03-03T16:56:50.660ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71822026-03-03T16:56:50.660ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71832026-03-03T16:56:50.663ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71842026-03-03T16:56:50.668ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71852026-03-03T16:56:50.668ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71862026-03-03T16:56:50.668ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71872026-03-03T16:56:50.669ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71882026-03-03T16:56:50.673ZDEBGtest_metrics (nexus): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
71892026-03-03T16:56:50.673ZDEBGtest_metrics (nexus): resolved firewall rules for sled agents sled_agent_rules = []
71902026-03-03T16:56:50.673ZDEBGtest_metrics (nexus): resolved 0 rules for sleds
71912026-03-03T16:56:50.696ZDEBGtest_metrics (nexus): resolved sleds for vpc default vpc_to_sled = []
71922026-03-03T16:56:50.696ZDEBGtest_metrics (nexus): sending firewall rules to sled agents
71932026-03-03T16:56:50.696ZINFOtest_metrics (nexus): updated firewall rules on 0 sleds
71942026-03-03T16:56:50.696ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71952026-03-03T16:56:50.696ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71962026-03-03T16:56:50.697ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71972026-03-03T16:56:50.700ZDEBGtest_metrics (SEC): saga log event new_state = N018 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
71982026-03-03T16:56:50.700ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
71992026-03-03T16:56:50.704ZDEBGtest_metrics (SEC): saga log event new_state = N019 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
72002026-03-03T16:56:50.705ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 19 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
72012026-03-03T16:56:50.707ZDEBGtest_metrics (SEC): saga log event new_state = N019 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
72022026-03-03T16:56:50.707ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
72032026-03-03T16:56:50.709ZDEBGtest_metrics (SEC): saga log event new_state = N021 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
72042026-03-03T16:56:50.710ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 21 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
72052026-03-03T16:56:50.711ZDEBGtest_metrics (SEC): saga log event new_state = N021 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
72062026-03-03T16:56:50.711ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 21 saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
72072026-03-03T16:56:50.713ZINFOtest_metrics (SEC): update for saga cached state new_state = Done saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 sec_id = 913233fe-92a8-4635-9572-183f495429c4
72082026-03-03T16:56:50.713ZINFOtest_metrics (SecStore): updating state new_state = done saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
72092026-03-03T16:56:50.717ZINFOtest_metrics (SEC): saga finished result = success saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
72102026-03-03T16:56:50.717ZINFOtest_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90
72112026-03-03T16:56:50.717ZINFOtest_metrics (SagaExecutor): saga finished saga_id = 903080a7-2877-40ab-8fe1-d29cd5047c90 saga_name = project-create saga_result = SagaResult { saga_id: 903080a7-2877-40ab-8fe1-d29cd5047c90, saga_log: SagaLog { saga_id: 903080a7-2877-40ab-8fe1-d29cd5047c90, unwinding: false, events: [N020 started, N020 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N018 started, N018 succeeded, N019 started, N019 succeeded, N021 started, N021 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "name": String("p-1"), "time_created": String("2026-03-03T16:56:50.342549Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.342549Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd7d:d5b2:24a7::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("5b83d48c-0655-438b-87aa-fbaf0aadd439")), 4: Succeeded(String("b7b34caf-70bf-442a-8106-d354c3fece87")), 5: Succeeded(String("171c30f3-81e3-4206-8632-49483fec19be")), 6: Succeeded(String("30baf4c8-2182-4a1b-962f-4fca3206ec47")), 7: Succeeded(String("c281a52c-9039-482e-aa75-23b56e03c3b4")), 8: Succeeded(String("453a352b-10aa-4873-adc2-4d11e650f92f")), 9: Succeeded(String("87b75148-24ab-4643-8655-087620cab27b")), 10: Succeeded(Array [Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "name": String("default"), "time_created": String("2026-03-03T16:56:50.388047Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.388047Z")}, "ipv6_prefix": String("fd7d:d5b2:24a7::/48"), "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "subnet_gen": Number(1), "system_router_id": String("b7b34caf-70bf-442a-8106-d354c3fece87"), "vni": Number(1795622)}]), 11: Succeeded(Object {"key": String("b7b34caf-70bf-442a-8106-d354c3fece87"), "lookup_type": Object {"ById": String("b7b34caf-70bf-442a-8106-d354c3fece87")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Array [Object {"key": String("453a352b-10aa-4873-adc2-4d11e650f92f"), "lookup_type": Object {"ById": String("453a352b-10aa-4873-adc2-4d11e650f92f")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("453a352b-10aa-4873-adc2-4d11e650f92f"), "name": String("default"), "time_created": String("2026-03-03T16:56:50.532233Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.532233Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd7d:d5b2:24a7::/64"), "rcgen": Number(1), "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}]), 15: Succeeded(Object {"key": String("c281a52c-9039-482e-aa75-23b56e03c3b4"), "lookup_type": Object {"ById": String("453a352b-10aa-4873-adc2-4d11e650f92f")}, "parent": Object {"key": String("b7b34caf-70bf-442a-8106-d354c3fece87"), "lookup_type": Object {"ById": String("b7b34caf-70bf-442a-8106-d354c3fece87")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}), 16: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("f53da394-128b-48df-ab46-9ace388b1578"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T16:56:50.569747Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.569747Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("a162907e-f8a8-41de-820c-cd2a1ff0a2cf"), "name": String("allow-ssh"), "time_created": String("2026-03-03T16:56:50.569770Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.569770Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("01c9da81-4447-48c1-bdd3-5621319463ac"), "name": String("allow-icmp"), "time_created": String("2026-03-03T16:56:50.569779Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.569779Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}]), 17: Succeeded(Object {"key": String("87b75148-24ab-4643-8655-087620cab27b"), "lookup_type": Object {"ById": String("87b75148-24ab-4643-8655-087620cab27b")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}), 18: Succeeded(Null), 19: Succeeded(Null), 20: Succeeded(Null), 21: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("87b75148-24ab-4643-8655-087620cab27b"), "default_subnet_id": String("453a352b-10aa-4873-adc2-4d11e650f92f"), "default_v4_route_id": String("171c30f3-81e3-4206-8632-49483fec19be"), "default_v6_route_id": String("30baf4c8-2182-4a1b-962f-4fca3206ec47"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("f53da394-128b-48df-ab46-9ace388b1578"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T16:56:50.569747Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.569747Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("a162907e-f8a8-41de-820c-cd2a1ff0a2cf"), "name": String("allow-ssh"), "time_created": String("2026-03-03T16:56:50.569770Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.569770Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("01c9da81-4447-48c1-bdd3-5621319463ac"), "name": String("allow-icmp"), "time_created": String("2026-03-03T16:56:50.569779Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.569779Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}], "gateway": Object {"key": String("87b75148-24ab-4643-8655-087620cab27b"), "lookup_type": Object {"ById": String("87b75148-24ab-4643-8655-087620cab27b")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "name": String("p-1"), "time_created": String("2026-03-03T16:56:50.342549Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.342549Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}], "route": Object {"key": String("c281a52c-9039-482e-aa75-23b56e03c3b4"), "lookup_type": Object {"ById": String("453a352b-10aa-4873-adc2-4d11e650f92f")}, "parent": Object {"key": String("b7b34caf-70bf-442a-8106-d354c3fece87"), "lookup_type": Object {"ById": String("b7b34caf-70bf-442a-8106-d354c3fece87")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}, "route4": Null, "route6": Null, "router": Object {"key": String("b7b34caf-70bf-442a-8106-d354c3fece87"), "lookup_type": Object {"ById": String("b7b34caf-70bf-442a-8106-d354c3fece87")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("453a352b-10aa-4873-adc2-4d11e650f92f"), "lookup_type": Object {"ById": String("453a352b-10aa-4873-adc2-4d11e650f92f")}, "parent": Object {"key": String("5b83d48c-0655-438b-87aa-fbaf0aadd439"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("453a352b-10aa-4873-adc2-4d11e650f92f"), "name": String("default"), "time_created": String("2026-03-03T16:56:50.532233Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:50.532233Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd7d:d5b2:24a7::/64"), "rcgen": Number(1), "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")}], "subnet_route_id": String("c281a52c-9039-482e-aa75-23b56e03c3b4"), "system_router_id": String("b7b34caf-70bf-442a-8106-d354c3fece87"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "lookup_type": Object {"ByName": String("p-1")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd7d:d5b2:24a7::/48"), "name": String("default")}}, "vpc_id": String("5b83d48c-0655-438b-87aa-fbaf0aadd439")} }) }
72122026-03-03T16:56:50.718ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72132026-03-03T16:56:50.718ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72142026-03-03T16:56:50.718ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72152026-03-03T16:56:50.718ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72162026-03-03T16:56:50.718ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72172026-03-03T16:56:50.726ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72182026-03-03T16:56:50.734ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72192026-03-03T16:56:50.734ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72202026-03-03T16:56:50.734ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72212026-03-03T16:56:50.734ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
72222026-03-03T16:56:50.755ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
72232026-03-03T16:56:50.756ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72242026-03-03T16:56:50.759ZINFOtest_metrics (dropshot_external): request completed latency_us = 484766 local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 0ba27c11-8679-4280-b4b2-359a827b586f response_code = 201 uri = /v1/projects
72252026-03-03T16:56:50.759ZINFOtest_metrics (external client test context): client received response status = 201
72262026-03-03T16:56:50.760ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
72272026-03-03T16:56:50.760ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
72282026-03-03T16:56:50.760ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
72292026-03-03T16:56:50.760ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
72302026-03-03T16:56:50.760ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
72312026-03-03T16:56:50.760ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
72322026-03-03T16:56:50.760ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
72332026-03-03T16:56:50.761ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
72342026-03-03T16:56:50.761ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10 version = 2026021900.0.0
72352026-03-03T16:56:50.761ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 306a7a75-264a-4838-a678-17107d41367e uri = /913233fe-92a8-4635-9572-183f495429c4
72362026-03-03T16:56:50.761ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
72372026-03-03T16:56:50.761ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
72382026-03-03T16:56:50.761ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72392026-03-03T16:56:50.761ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72402026-03-03T16:56:50.762ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72412026-03-03T16:56:50.774ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 12799 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 306a7a75-264a-4838-a678-17107d41367e response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
72422026-03-03T16:56:50.777ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
72432026-03-03T16:56:50.786ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
72442026-03-03T16:56:50.786ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
72452026-03-03T16:56:50.786ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
72462026-03-03T16:56:50.786ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
72472026-03-03T16:56:50.786ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
72482026-03-03T16:56:50.786ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
72492026-03-03T16:56:50.786ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
72502026-03-03T16:56:50.786ZDEBGtest_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72512026-03-03T16:56:50.789ZDEBGtest_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
72522026-03-03T16:56:50.800ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 26 sql = INSERT INTO oximeter.fields_string FORMAT Native
72532026-03-03T16:56:50.801ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72542026-03-03T16:56:50.801ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72552026-03-03T16:56:50.802ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72562026-03-03T16:56:50.803ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 26 table_name = fields_string
72572026-03-03T16:56:50.803ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
72582026-03-03T16:56:50.805ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = fields_u16
72592026-03-03T16:56:50.805ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
72602026-03-03T16:56:50.805ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
72612026-03-03T16:56:50.805ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
72622026-03-03T16:56:50.805ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72632026-03-03T16:56:50.805ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72642026-03-03T16:56:50.805ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72652026-03-03T16:56:50.807ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_uuid
72662026-03-03T16:56:50.807ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
72672026-03-03T16:56:50.807ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
72682026-03-03T16:56:50.807ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72692026-03-03T16:56:50.807ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72702026-03-03T16:56:50.808ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72712026-03-03T16:56:50.811ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
72722026-03-03T16:56:50.812ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
72732026-03-03T16:56:50.812ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72742026-03-03T16:56:50.812ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72752026-03-03T16:56:50.812ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72762026-03-03T16:56:50.813ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = measurements_histogramu64
72772026-03-03T16:56:50.813ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 4 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
72782026-03-03T16:56:50.814ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
72792026-03-03T16:56:50.814ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
72802026-03-03T16:56:50.814ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72812026-03-03T16:56:50.814ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72822026-03-03T16:56:50.814ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72832026-03-03T16:56:50.815ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 4 table_name = measurements_i64
72842026-03-03T16:56:50.815ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72852026-03-03T16:56:50.815ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72862026-03-03T16:56:50.815ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
72872026-03-03T16:56:50.816ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
72882026-03-03T16:56:50.817ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
72892026-03-03T16:56:50.817ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
72902026-03-03T16:56:50.818ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
72912026-03-03T16:56:50.818ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
72922026-03-03T16:56:50.818ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
72932026-03-03T16:56:50.819ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
72942026-03-03T16:56:50.820ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
72952026-03-03T16:56:50.820ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
72962026-03-03T16:56:50.823ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
72972026-03-03T16:56:50.825ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
72982026-03-03T16:56:50.825ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
72992026-03-03T16:56:50.825ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73002026-03-03T16:56:50.826ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73012026-03-03T16:56:50.826ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73022026-03-03T16:56:50.826ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73032026-03-03T16:56:50.826ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73042026-03-03T16:56:50.828ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73052026-03-03T16:56:50.828ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73062026-03-03T16:56:50.828ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73072026-03-03T16:56:50.829ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73082026-03-03T16:56:50.830ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73092026-03-03T16:56:50.832ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73102026-03-03T16:56:50.832ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73112026-03-03T16:56:50.832ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73122026-03-03T16:56:50.832ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73132026-03-03T16:56:50.834ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73142026-03-03T16:56:50.834ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73152026-03-03T16:56:50.834ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73162026-03-03T16:56:50.835ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73172026-03-03T16:56:50.836ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73182026-03-03T16:56:50.836ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73192026-03-03T16:56:50.836ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73202026-03-03T16:56:50.836ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73212026-03-03T16:56:50.839ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73222026-03-03T16:56:50.842ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73232026-03-03T16:56:50.842ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73242026-03-03T16:56:50.842ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73252026-03-03T16:56:50.842ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73262026-03-03T16:56:50.842ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73272026-03-03T16:56:50.842ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73282026-03-03T16:56:50.842ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73292026-03-03T16:56:50.843ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73302026-03-03T16:56:50.848ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73312026-03-03T16:56:50.848ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73322026-03-03T16:56:50.848ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73332026-03-03T16:56:50.848ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73342026-03-03T16:56:50.848ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73352026-03-03T16:56:50.848ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73362026-03-03T16:56:50.850ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73372026-03-03T16:56:50.850ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73382026-03-03T16:56:50.850ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73392026-03-03T16:56:50.851ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73402026-03-03T16:56:50.853ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73412026-03-03T16:56:50.854ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73422026-03-03T16:56:50.856ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '41c1c314-b812-4fb3-ab31-28abfa63ce10') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
73432026-03-03T16:56:50.856ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
73442026-03-03T16:56:50.857ZDEBGtest_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
73452026-03-03T16:56:50.859ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (177066575428309413) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:50.760290175' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
73462026-03-03T16:56:50.862ZINFOtest_metrics (dropshot_external): request completed latency_us = 101777 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6e4a7eb6-cdf2-4606-b980-826c47aa1b92 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.760290175Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73472026-03-03T16:56:50.863ZINFOtest_metrics (external client test context): client received response status = 200
73482026-03-03T16:56:50.863ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73492026-03-03T16:56:50.863ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
73502026-03-03T16:56:50.863ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
73512026-03-03T16:56:50.863ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
73522026-03-03T16:56:50.863ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
73532026-03-03T16:56:50.863ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
73542026-03-03T16:56:50.863ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
73552026-03-03T16:56:50.863ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73562026-03-03T16:56:50.863ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10 version = 2026021900.0.0
73572026-03-03T16:56:50.863ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 98d1f096-c4a9-4d49-b709-147b8903fb7d uri = /913233fe-92a8-4635-9572-183f495429c4
73582026-03-03T16:56:50.864ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73592026-03-03T16:56:50.865ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
73602026-03-03T16:56:50.865ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
73612026-03-03T16:56:50.865ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
73622026-03-03T16:56:50.865ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
73632026-03-03T16:56:50.870ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6065 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 98d1f096-c4a9-4d49-b709-147b8903fb7d response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
73642026-03-03T16:56:50.870ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
73652026-03-03T16:56:50.877ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
73662026-03-03T16:56:50.877ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
73672026-03-03T16:56:50.877ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
73682026-03-03T16:56:50.877ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
73692026-03-03T16:56:50.877ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
73702026-03-03T16:56:50.877ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
73712026-03-03T16:56:50.877ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
73722026-03-03T16:56:50.877ZDEBGtest_metrics (results-sink): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
73732026-03-03T16:56:50.877ZDEBGtest_metrics (clickhouse-client): unrolling 12 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
73742026-03-03T16:56:50.882ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
73752026-03-03T16:56:50.883ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
73762026-03-03T16:56:50.883ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
73772026-03-03T16:56:50.884ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
73782026-03-03T16:56:50.885ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 24 table_name = fields_string
73792026-03-03T16:56:50.887ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
73802026-03-03T16:56:50.887ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
73812026-03-03T16:56:50.887ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
73822026-03-03T16:56:50.887ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
73832026-03-03T16:56:50.887ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
73842026-03-03T16:56:50.887ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
73852026-03-03T16:56:50.889ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = fields_u16
73862026-03-03T16:56:50.890ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
73872026-03-03T16:56:50.890ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
73882026-03-03T16:56:50.890ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
73892026-03-03T16:56:50.890ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
73902026-03-03T16:56:50.890ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
73912026-03-03T16:56:50.892ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = fields_uuid
73922026-03-03T16:56:50.895ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
73932026-03-03T16:56:50.895ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
73942026-03-03T16:56:50.895ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
73952026-03-03T16:56:50.895ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
73962026-03-03T16:56:50.895ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
73972026-03-03T16:56:50.895ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
73982026-03-03T16:56:50.902ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
73992026-03-03T16:56:50.903ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
74002026-03-03T16:56:50.903ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
74012026-03-03T16:56:50.903ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
74022026-03-03T16:56:50.903ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
74032026-03-03T16:56:50.906ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
74042026-03-03T16:56:50.906ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
74052026-03-03T16:56:50.906ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
74062026-03-03T16:56:50.906ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
74072026-03-03T16:56:50.907ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = measurements_histogramu64
74082026-03-03T16:56:50.907ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
74092026-03-03T16:56:50.907ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
74102026-03-03T16:56:50.907ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
74112026-03-03T16:56:50.909ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
74122026-03-03T16:56:50.909ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
74132026-03-03T16:56:50.911ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
74142026-03-03T16:56:50.911ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74152026-03-03T16:56:50.911ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74162026-03-03T16:56:50.911ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74172026-03-03T16:56:50.911ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74182026-03-03T16:56:50.911ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74192026-03-03T16:56:50.911ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74202026-03-03T16:56:50.914ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74212026-03-03T16:56:50.914ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74222026-03-03T16:56:50.914ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74232026-03-03T16:56:50.914ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74242026-03-03T16:56:50.915ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
74252026-03-03T16:56:50.915ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
74262026-03-03T16:56:50.916ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74272026-03-03T16:56:50.918ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74282026-03-03T16:56:50.918ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74292026-03-03T16:56:50.918ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74302026-03-03T16:56:50.918ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74312026-03-03T16:56:50.919ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
74322026-03-03T16:56:50.920ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
74332026-03-03T16:56:50.921ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74342026-03-03T16:56:50.921ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74352026-03-03T16:56:50.921ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74362026-03-03T16:56:50.921ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74372026-03-03T16:56:50.921ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74382026-03-03T16:56:50.922ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74392026-03-03T16:56:50.922ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74402026-03-03T16:56:50.922ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74412026-03-03T16:56:50.924ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74422026-03-03T16:56:50.924ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74432026-03-03T16:56:50.924ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74442026-03-03T16:56:50.924ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74452026-03-03T16:56:50.926ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74462026-03-03T16:56:50.927ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74472026-03-03T16:56:50.927ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74482026-03-03T16:56:50.927ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74492026-03-03T16:56:50.928ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74502026-03-03T16:56:50.933ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74512026-03-03T16:56:50.933ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74522026-03-03T16:56:50.933ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74532026-03-03T16:56:50.933ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74542026-03-03T16:56:50.933ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74552026-03-03T16:56:50.933ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74562026-03-03T16:56:50.937ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74572026-03-03T16:56:50.938ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74582026-03-03T16:56:50.938ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74592026-03-03T16:56:50.938ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74602026-03-03T16:56:50.940ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74612026-03-03T16:56:50.942ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74622026-03-03T16:56:50.945ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '41c1c314-b812-4fb3-ab31-28abfa63ce10') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
74632026-03-03T16:56:50.946ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (11667673099072290478) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:50.863338739' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
74642026-03-03T16:56:50.951ZINFOtest_metrics (dropshot_external): request completed latency_us = 87289 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4cc968db-c18b-4ae6-b86f-25a2b735e034 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.863338739Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74652026-03-03T16:56:50.951ZINFOtest_metrics (external client test context): client received response status = 200
74662026-03-03T16:56:50.951ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74672026-03-03T16:56:50.951ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
74682026-03-03T16:56:50.951ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
74692026-03-03T16:56:50.951ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
74702026-03-03T16:56:50.951ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
74712026-03-03T16:56:50.951ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
74722026-03-03T16:56:50.952ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
74732026-03-03T16:56:50.952ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74742026-03-03T16:56:50.952ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10 version = 2026021900.0.0
74752026-03-03T16:56:50.952ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 3d5e6e1a-7c49-460d-a729-5400a6194ed2 uri = /913233fe-92a8-4635-9572-183f495429c4
74762026-03-03T16:56:50.952ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74772026-03-03T16:56:50.952ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
74782026-03-03T16:56:50.952ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
74792026-03-03T16:56:50.952ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
74802026-03-03T16:56:50.953ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
74812026-03-03T16:56:50.958ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6267 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 3d5e6e1a-7c49-460d-a729-5400a6194ed2 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
74822026-03-03T16:56:50.959ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
74832026-03-03T16:56:50.965ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
74842026-03-03T16:56:50.965ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
74852026-03-03T16:56:50.965ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
74862026-03-03T16:56:50.965ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
74872026-03-03T16:56:50.965ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
74882026-03-03T16:56:50.965ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
74892026-03-03T16:56:50.965ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
74902026-03-03T16:56:50.965ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
74912026-03-03T16:56:50.965ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
74922026-03-03T16:56:50.965ZDEBGtest_metrics (results-sink): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
74932026-03-03T16:56:50.966ZDEBGtest_metrics (clickhouse-client): unrolling 12 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
74942026-03-03T16:56:50.971ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
74952026-03-03T16:56:50.972ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
74962026-03-03T16:56:50.972ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
74972026-03-03T16:56:50.972ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
74982026-03-03T16:56:50.974ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 24 table_name = fields_string
74992026-03-03T16:56:50.974ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
75002026-03-03T16:56:50.974ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
75012026-03-03T16:56:50.974ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
75022026-03-03T16:56:50.974ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
75032026-03-03T16:56:50.974ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
75042026-03-03T16:56:50.974ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
75052026-03-03T16:56:50.977ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = fields_u16
75062026-03-03T16:56:50.977ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
75072026-03-03T16:56:50.977ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
75082026-03-03T16:56:50.978ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
75092026-03-03T16:56:50.978ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
75102026-03-03T16:56:50.978ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
75112026-03-03T16:56:50.979ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
75122026-03-03T16:56:50.983ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
75132026-03-03T16:56:50.987ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
75142026-03-03T16:56:50.987ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
75152026-03-03T16:56:50.987ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
75162026-03-03T16:56:50.987ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = fields_uuid
75172026-03-03T16:56:50.987ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
75182026-03-03T16:56:50.992ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = measurements_histogramu64
75192026-03-03T16:56:50.992ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
75202026-03-03T16:56:50.992ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
75212026-03-03T16:56:50.992ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
75222026-03-03T16:56:50.993ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
75232026-03-03T16:56:50.994ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
75242026-03-03T16:56:50.994ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
75252026-03-03T16:56:50.994ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
75262026-03-03T16:56:50.995ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
75272026-03-03T16:56:50.995ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
75282026-03-03T16:56:51.006ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
75292026-03-03T16:56:51.006ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
75302026-03-03T16:56:51.006ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
75312026-03-03T16:56:51.006ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
75322026-03-03T16:56:51.016ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
75332026-03-03T16:56:51.016ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
75342026-03-03T16:56:51.016ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
75352026-03-03T16:56:51.017ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
75362026-03-03T16:56:51.022ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
75372026-03-03T16:56:51.024ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
75382026-03-03T16:56:51.024ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75392026-03-03T16:56:51.024ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75402026-03-03T16:56:51.024ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75412026-03-03T16:56:51.024ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75422026-03-03T16:56:51.024ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75432026-03-03T16:56:51.025ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75442026-03-03T16:56:51.030ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75452026-03-03T16:56:51.030ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75462026-03-03T16:56:51.030ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75472026-03-03T16:56:51.031ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75482026-03-03T16:56:51.035ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75492026-03-03T16:56:51.038ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75502026-03-03T16:56:51.038ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75512026-03-03T16:56:51.038ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75522026-03-03T16:56:51.039ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75532026-03-03T16:56:51.041ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75542026-03-03T16:56:51.041ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75552026-03-03T16:56:51.042ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75562026-03-03T16:56:51.045ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75572026-03-03T16:56:51.045ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75582026-03-03T16:56:51.045ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75592026-03-03T16:56:51.045ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75602026-03-03T16:56:51.045ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75612026-03-03T16:56:51.047ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75622026-03-03T16:56:51.047ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75632026-03-03T16:56:51.047ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75642026-03-03T16:56:51.048ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75652026-03-03T16:56:51.059ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75662026-03-03T16:56:51.059ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75672026-03-03T16:56:51.059ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75682026-03-03T16:56:51.060ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75692026-03-03T16:56:51.063ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75702026-03-03T16:56:51.069ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75712026-03-03T16:56:51.069ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75722026-03-03T16:56:51.069ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75732026-03-03T16:56:51.073ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75742026-03-03T16:56:51.073ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75752026-03-03T16:56:51.073ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75762026-03-03T16:56:51.079ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
75772026-03-03T16:56:51.079ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
75782026-03-03T16:56:51.079ZDEBGtest_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
75792026-03-03T16:56:51.087ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75802026-03-03T16:56:51.087ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75812026-03-03T16:56:51.087ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75822026-03-03T16:56:51.087ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75832026-03-03T16:56:51.098ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75842026-03-03T16:56:51.098ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75852026-03-03T16:56:51.098ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '41c1c314-b812-4fb3-ab31-28abfa63ce10') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
75862026-03-03T16:56:51.107ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (18411839779477951260) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:50.951679749' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
75872026-03-03T16:56:51.111ZINFOtest_metrics (dropshot_external): request completed latency_us = 158933 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 4ef95025-bf38-44f1-a097-4e8d09febbc7 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:50.951679749Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
75882026-03-03T16:56:51.111ZINFOtest_metrics (external client test context): client received response status = 200
75892026-03-03T16:56:51.111ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:40151/v1/projects
75902026-03-03T16:56:51.112ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc uri = /v1/projects
75912026-03-03T16:56:51.112ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc uri = /v1/projects version = 2026021900.0.0
75922026-03-03T16:56:51.112ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc uri = /v1/projects
75932026-03-03T16:56:51.112ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/projects
75942026-03-03T16:56:51.112ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
75952026-03-03T16:56:51.112ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
75962026-03-03T16:56:51.112ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
75972026-03-03T16:56:51.123ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
75982026-03-03T16:56:51.123ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
75992026-03-03T16:56:51.123ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
76002026-03-03T16:56:51.126ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
76012026-03-03T16:56:51.126ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
76022026-03-03T16:56:51.126ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
76032026-03-03T16:56:51.126ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
76042026-03-03T16:56:51.127ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
76052026-03-03T16:56:51.128ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
76062026-03-03T16:56:51.128ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
76072026-03-03T16:56:51.128ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
76082026-03-03T16:56:51.129ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
76092026-03-03T16:56:51.130ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
76102026-03-03T16:56:51.132ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
76112026-03-03T16:56:51.132ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
76122026-03-03T16:56:51.132ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
76132026-03-03T16:56:51.133ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
76142026-03-03T16:56:51.134ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
76152026-03-03T16:56:51.134ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
76162026-03-03T16:56:51.134ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
76172026-03-03T16:56:51.134ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
76182026-03-03T16:56:51.134ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
76192026-03-03T16:56:51.179ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
76202026-03-03T16:56:51.179ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
76212026-03-03T16:56:51.179ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
76222026-03-03T16:56:51.179ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
76232026-03-03T16:56:51.180ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
76242026-03-03T16:56:51.180ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
76252026-03-03T16:56:51.181ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
76262026-03-03T16:56:51.184ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
76272026-03-03T16:56:51.184ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc uri = /v1/projects
76282026-03-03T16:56:51.184ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76292026-03-03T16:56:51.184ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76302026-03-03T16:56:51.184ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76312026-03-03T16:56:51.184ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76322026-03-03T16:56:51.185ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76332026-03-03T16:56:51.187ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76342026-03-03T16:56:51.189ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76352026-03-03T16:56:51.189ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76362026-03-03T16:56:51.189ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76372026-03-03T16:56:51.189ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76382026-03-03T16:56:51.195ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76392026-03-03T16:56:51.195ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76402026-03-03T16:56:51.195ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76412026-03-03T16:56:51.195ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76422026-03-03T16:56:51.195ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76432026-03-03T16:56:51.199ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76442026-03-03T16:56:51.199ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76452026-03-03T16:56:51.199ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76462026-03-03T16:56:51.200ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76472026-03-03T16:56:51.203ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76482026-03-03T16:56:51.207ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
76492026-03-03T16:56:51.207ZINFOtest_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76502026-03-03T16:56:51.207ZINFOtest_metrics (SagaExecutor): preparing saga saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create
76512026-03-03T16:56:51.207ZINFOtest_metrics (SEC): saga create dag = {"end_node":21,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[16,17,null],[17,18,null],[2,3,null],[18,19,null],[20,0,null],[19,21,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSubnetRouteId","name":"subnet_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet_route","label":"VpcCreateSubnetRoute","name":"route"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"001de000-5110-4000-8000-000000000000","lookup_type":{"ById":"001de000-5110-4000-8000-000000000000"},"parent":null},"project_create":{"description":"a pier","name":"p-2"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"project-create","start_node":20} saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
76522026-03-03T16:56:51.207ZINFOtest_metrics (SecStore): creating saga saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create
76532026-03-03T16:56:51.213ZINFOtest_metrics (SagaExecutor): starting saga saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create
76542026-03-03T16:56:51.213ZINFOtest_metrics (SEC): saga start saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
76552026-03-03T16:56:51.214ZDEBGtest_metrics (SEC): saga log event new_state = N020 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
76562026-03-03T16:56:51.214ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 20 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76572026-03-03T16:56:51.217ZDEBGtest_metrics (SEC): saga log event new_state = N020 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
76582026-03-03T16:56:51.217ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 20 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76592026-03-03T16:56:51.219ZDEBGtest_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
76602026-03-03T16:56:51.219ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76612026-03-03T16:56:51.221ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76622026-03-03T16:56:51.221ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76632026-03-03T16:56:51.221ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76642026-03-03T16:56:51.221ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76652026-03-03T16:56:51.222ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76662026-03-03T16:56:51.227ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76672026-03-03T16:56:51.227ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76682026-03-03T16:56:51.227ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76692026-03-03T16:56:51.228ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76702026-03-03T16:56:51.238ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76712026-03-03T16:56:51.241ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76722026-03-03T16:56:51.241ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76732026-03-03T16:56:51.241ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76742026-03-03T16:56:51.242ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
76752026-03-03T16:56:51.249ZDEBGtest_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
76762026-03-03T16:56:51.249ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("1ce5f420-4363-42e9-8d76-1783996da352"), "name": String("p-2"), "time_created": String("2026-03-03T16:56:51.221293Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.221293Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}]) node_id = 0 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76772026-03-03T16:56:51.251ZDEBGtest_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
76782026-03-03T16:56:51.251ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76792026-03-03T16:56:51.253ZDEBGtest_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
76802026-03-03T16:56:51.253ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd0a:9f1d:e998::/48"), "name": String("default")}}) node_id = 1 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76812026-03-03T16:56:51.255ZDEBGtest_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
76822026-03-03T16:56:51.255ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76832026-03-03T16:56:51.256ZDEBGtest_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
76842026-03-03T16:56:51.256ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76852026-03-03T16:56:51.258ZDEBGtest_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
76862026-03-03T16:56:51.258ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76872026-03-03T16:56:51.261ZDEBGtest_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
76882026-03-03T16:56:51.261ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("164edcf0-af21-4153-9d5d-062b82786cd6")) node_id = 3 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76892026-03-03T16:56:51.264ZDEBGtest_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
76902026-03-03T16:56:51.264ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76912026-03-03T16:56:51.268ZDEBGtest_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
76922026-03-03T16:56:51.268ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c")) node_id = 4 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76932026-03-03T16:56:51.272ZDEBGtest_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
76942026-03-03T16:56:51.272ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76952026-03-03T16:56:51.272ZDEBGtest_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
76962026-03-03T16:56:51.272ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("2f6656e9-444c-4aff-864e-b8a58bfbe714")) node_id = 5 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76972026-03-03T16:56:51.273ZDEBGtest_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
76982026-03-03T16:56:51.273ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
76992026-03-03T16:56:51.274ZDEBGtest_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
77002026-03-03T16:56:51.276ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("98c2c113-b0e6-4676-ba17-1be56559785f")) node_id = 6 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77012026-03-03T16:56:51.277ZDEBGtest_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
77022026-03-03T16:56:51.277ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77032026-03-03T16:56:51.279ZDEBGtest_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
77042026-03-03T16:56:51.279ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("938516fc-298f-4896-a190-40504168530f")) node_id = 7 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77052026-03-03T16:56:51.280ZDEBGtest_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
77062026-03-03T16:56:51.280ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77072026-03-03T16:56:51.282ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
77082026-03-03T16:56:51.282ZDEBGtest_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
77092026-03-03T16:56:51.282ZDEBGtest_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
77102026-03-03T16:56:51.282ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("8c18134b-e3b1-4b36-bb1c-47f9d50394df")) node_id = 8 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77112026-03-03T16:56:51.285ZDEBGtest_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
77122026-03-03T16:56:51.285ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77132026-03-03T16:56:51.287ZDEBGtest_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
77142026-03-03T16:56:51.287ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("c43cc1df-fc64-43a6-ad10-c9fadfdae457")) node_id = 9 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77152026-03-03T16:56:51.292ZDEBGtest_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
77162026-03-03T16:56:51.292ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77172026-03-03T16:56:51.293ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77182026-03-03T16:56:51.293ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77192026-03-03T16:56:51.293ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77202026-03-03T16:56:51.294ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77212026-03-03T16:56:51.294ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77222026-03-03T16:56:51.296ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77232026-03-03T16:56:51.296ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77242026-03-03T16:56:51.296ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77252026-03-03T16:56:51.296ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77262026-03-03T16:56:51.298ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77272026-03-03T16:56:51.298ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77282026-03-03T16:56:51.298ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77292026-03-03T16:56:51.299ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77302026-03-03T16:56:51.300ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77312026-03-03T16:56:51.305ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77322026-03-03T16:56:51.306ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77332026-03-03T16:56:51.306ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77342026-03-03T16:56:51.306ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77352026-03-03T16:56:51.310ZDEBGtest_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
77362026-03-03T16:56:51.310ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "name": String("default"), "time_created": String("2026-03-03T16:56:51.293869Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.293869Z")}, "ipv6_prefix": String("fd0a:9f1d:e998::/48"), "project_id": String("1ce5f420-4363-42e9-8d76-1783996da352"), "subnet_gen": Number(1), "system_router_id": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c"), "vni": Number(16597712)}]) node_id = 10 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77372026-03-03T16:56:51.316ZDEBGtest_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
77382026-03-03T16:56:51.316ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77392026-03-03T16:56:51.318ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77402026-03-03T16:56:51.318ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77412026-03-03T16:56:51.318ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77422026-03-03T16:56:51.318ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77432026-03-03T16:56:51.319ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77442026-03-03T16:56:51.321ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77452026-03-03T16:56:51.322ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77462026-03-03T16:56:51.322ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77472026-03-03T16:56:51.322ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77482026-03-03T16:56:51.323ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77492026-03-03T16:56:51.323ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77502026-03-03T16:56:51.323ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77512026-03-03T16:56:51.323ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77522026-03-03T16:56:51.325ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77532026-03-03T16:56:51.329ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77542026-03-03T16:56:51.329ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77552026-03-03T16:56:51.329ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77562026-03-03T16:56:51.330ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77572026-03-03T16:56:51.332ZDEBGtest_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
77582026-03-03T16:56:51.332ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c"), "lookup_type": Object {"ById": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}) node_id = 11 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77592026-03-03T16:56:51.333ZDEBGtest_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
77602026-03-03T16:56:51.333ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77612026-03-03T16:56:51.335ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") }, key: 9ac5f9fa-5fbd-4399-b0a3-97563c45f94c, lookup_type: ById(9ac5f9fa-5fbd-4399-b0a3-97563c45f94c) } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77622026-03-03T16:56:51.335ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77632026-03-03T16:56:51.335ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77642026-03-03T16:56:51.335ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77652026-03-03T16:56:51.336ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77662026-03-03T16:56:51.341ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77672026-03-03T16:56:51.341ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77682026-03-03T16:56:51.341ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77692026-03-03T16:56:51.341ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77702026-03-03T16:56:51.356ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77712026-03-03T16:56:51.356ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77722026-03-03T16:56:51.356ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77732026-03-03T16:56:51.357ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77742026-03-03T16:56:51.359ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77752026-03-03T16:56:51.364ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") }, key: 9ac5f9fa-5fbd-4399-b0a3-97563c45f94c, lookup_type: ById(9ac5f9fa-5fbd-4399-b0a3-97563c45f94c) } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77762026-03-03T16:56:51.364ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77772026-03-03T16:56:51.364ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77782026-03-03T16:56:51.365ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77792026-03-03T16:56:51.368ZDEBGtest_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
77802026-03-03T16:56:51.369ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77812026-03-03T16:56:51.370ZDEBGtest_metrics (SEC): saga log event new_state = N013 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
77822026-03-03T16:56:51.370ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
77832026-03-03T16:56:51.374ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") }, key: 9ac5f9fa-5fbd-4399-b0a3-97563c45f94c, lookup_type: ById(9ac5f9fa-5fbd-4399-b0a3-97563c45f94c) } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77842026-03-03T16:56:51.375ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77852026-03-03T16:56:51.375ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77862026-03-03T16:56:51.375ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77872026-03-03T16:56:51.375ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77882026-03-03T16:56:51.377ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77892026-03-03T16:56:51.378ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77902026-03-03T16:56:51.378ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77912026-03-03T16:56:51.378ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77922026-03-03T16:56:51.383ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
77932026-03-03T16:56:51.383ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
77942026-03-03T16:56:51.383ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77952026-03-03T16:56:51.383ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77962026-03-03T16:56:51.383ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77972026-03-03T16:56:51.384ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77982026-03-03T16:56:51.386ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
77992026-03-03T16:56:51.391ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") }, key: 9ac5f9fa-5fbd-4399-b0a3-97563c45f94c, lookup_type: ById(9ac5f9fa-5fbd-4399-b0a3-97563c45f94c) } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78002026-03-03T16:56:51.394ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78012026-03-03T16:56:51.394ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78022026-03-03T16:56:51.394ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78032026-03-03T16:56:51.403ZDEBGtest_metrics (SEC): saga log event new_state = N013 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
78042026-03-03T16:56:51.403ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
78052026-03-03T16:56:51.405ZDEBGtest_metrics (SEC): saga log event new_state = N014 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
78062026-03-03T16:56:51.405ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
78072026-03-03T16:56:51.407ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78082026-03-03T16:56:51.407ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78092026-03-03T16:56:51.407ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78102026-03-03T16:56:51.407ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78112026-03-03T16:56:51.407ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78122026-03-03T16:56:51.410ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78132026-03-03T16:56:51.410ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78142026-03-03T16:56:51.410ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78152026-03-03T16:56:51.411ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78162026-03-03T16:56:51.415ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78172026-03-03T16:56:51.415ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78182026-03-03T16:56:51.415ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78192026-03-03T16:56:51.416ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78202026-03-03T16:56:51.420ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78212026-03-03T16:56:51.425ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78222026-03-03T16:56:51.432ZDEBGtest_metrics (SEC): saga log event new_state = N014 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
78232026-03-03T16:56:51.432ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df"), "lookup_type": Object {"ById": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df"), "name": String("default"), "time_created": String("2026-03-03T16:56:51.406979Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.406979Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd0a:9f1d:e998::/64"), "rcgen": Number(1), "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}]) node_id = 14 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
78242026-03-03T16:56:51.434ZDEBGtest_metrics (SEC): saga log event new_state = N015 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
78252026-03-03T16:56:51.436ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
78262026-03-03T16:56:51.437ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") }, key: 9ac5f9fa-5fbd-4399-b0a3-97563c45f94c, lookup_type: ById(9ac5f9fa-5fbd-4399-b0a3-97563c45f94c) } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78272026-03-03T16:56:51.437ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78282026-03-03T16:56:51.437ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78292026-03-03T16:56:51.437ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78302026-03-03T16:56:51.438ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78312026-03-03T16:56:51.441ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78322026-03-03T16:56:51.441ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78332026-03-03T16:56:51.441ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78342026-03-03T16:56:51.442ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78352026-03-03T16:56:51.444ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78362026-03-03T16:56:51.444ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78372026-03-03T16:56:51.444ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78382026-03-03T16:56:51.444ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78392026-03-03T16:56:51.447ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78402026-03-03T16:56:51.453ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") }, key: 9ac5f9fa-5fbd-4399-b0a3-97563c45f94c, lookup_type: ById(9ac5f9fa-5fbd-4399-b0a3-97563c45f94c) } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78412026-03-03T16:56:51.453ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78422026-03-03T16:56:51.453ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78432026-03-03T16:56:51.453ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78442026-03-03T16:56:51.457ZDEBGtest_metrics (SEC): saga log event new_state = N015 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
78452026-03-03T16:56:51.459ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("938516fc-298f-4896-a190-40504168530f"), "lookup_type": Object {"ById": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df")}, "parent": Object {"key": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c"), "lookup_type": Object {"ById": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}) node_id = 15 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
78462026-03-03T16:56:51.459ZDEBGtest_metrics (SEC): saga log event new_state = N016 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
78472026-03-03T16:56:51.459ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
78482026-03-03T16:56:51.461ZDEBGtest_metrics (nexus): default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: ba66728c-191f-423d-935d-a0b022500970, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2026-03-03T16:56:51.461536Z, time_modified: 2026-03-03T16:56:51.461536Z, time_deleted: None }, vpc_id: 164edcf0-af21-4153-9d5d-062b82786cd6, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 60f95435-dc8a-4333-b865-b4174b9caa2c, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2026-03-03T16:56:51.461553Z, time_modified: 2026-03-03T16:56:51.461553Z, time_deleted: None }, vpc_id: 164edcf0-af21-4153-9d5d-062b82786cd6, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 6c9b7b14-6c8c-40cd-8395-4655a800565c, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2026-03-03T16:56:51.461559Z, time_modified: 2026-03-03T16:56:51.461559Z, time_deleted: None }, vpc_id: 164edcf0-af21-4153-9d5d-062b82786cd6, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp(None))]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
78492026-03-03T16:56:51.462ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78502026-03-03T16:56:51.462ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78512026-03-03T16:56:51.462ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78522026-03-03T16:56:51.462ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78532026-03-03T16:56:51.462ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78542026-03-03T16:56:51.464ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78552026-03-03T16:56:51.464ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78562026-03-03T16:56:51.464ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78572026-03-03T16:56:51.464ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78582026-03-03T16:56:51.466ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78592026-03-03T16:56:51.466ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78602026-03-03T16:56:51.466ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78612026-03-03T16:56:51.467ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78622026-03-03T16:56:51.468ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78632026-03-03T16:56:51.473ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78642026-03-03T16:56:51.473ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78652026-03-03T16:56:51.473ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78662026-03-03T16:56:51.473ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78672026-03-03T16:56:51.485ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
78682026-03-03T16:56:51.485ZDEBGtest_metrics (results-sink-cluster): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
78692026-03-03T16:56:51.504ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
78702026-03-03T16:56:51.540ZDEBGtest_metrics (SEC): saga log event new_state = N016 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
78712026-03-03T16:56:51.540ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("ba66728c-191f-423d-935d-a0b022500970"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T16:56:51.461536Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.461536Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("60f95435-dc8a-4333-b865-b4174b9caa2c"), "name": String("allow-ssh"), "time_created": String("2026-03-03T16:56:51.461553Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.461553Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("6c9b7b14-6c8c-40cd-8395-4655a800565c"), "name": String("allow-icmp"), "time_created": String("2026-03-03T16:56:51.461559Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.461559Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}]) node_id = 16 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
78722026-03-03T16:56:51.543ZDEBGtest_metrics (SEC): saga log event new_state = N017 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
78732026-03-03T16:56:51.543ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
78742026-03-03T16:56:51.545ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78752026-03-03T16:56:51.546ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78762026-03-03T16:56:51.546ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78772026-03-03T16:56:51.546ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78782026-03-03T16:56:51.546ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78792026-03-03T16:56:51.548ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78802026-03-03T16:56:51.548ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78812026-03-03T16:56:51.548ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78822026-03-03T16:56:51.548ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78832026-03-03T16:56:51.550ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78842026-03-03T16:56:51.550ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78852026-03-03T16:56:51.550ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78862026-03-03T16:56:51.551ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78872026-03-03T16:56:51.552ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78882026-03-03T16:56:51.556ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ByName("p-2") }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78892026-03-03T16:56:51.557ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78902026-03-03T16:56:51.557ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78912026-03-03T16:56:51.557ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78922026-03-03T16:56:51.560ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78932026-03-03T16:56:51.562ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78942026-03-03T16:56:51.562ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78952026-03-03T16:56:51.563ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78962026-03-03T16:56:51.563ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78972026-03-03T16:56:51.563ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
78982026-03-03T16:56:51.590ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
78992026-03-03T16:56:51.590ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
79002026-03-03T16:56:51.590ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
79012026-03-03T16:56:51.591ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79022026-03-03T16:56:51.591ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
79032026-03-03T16:56:51.592ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
79042026-03-03T16:56:51.592ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
79052026-03-03T16:56:51.592ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
79062026-03-03T16:56:51.635ZWARNtest_metrics (SagaExecutor): Default ip pool lookup failed: Invalid Request: Multiple default unicast IP pools exist with different IP versions. Please specify ip_version (v4 or v6) or provide an explicit pool.. Default gateway has no ip pool association authenticated = true saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79072026-03-03T16:56:51.635ZDEBGtest_metrics (SEC): saga log event new_state = N017 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
79082026-03-03T16:56:51.635ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("c43cc1df-fc64-43a6-ad10-c9fadfdae457"), "lookup_type": Object {"ById": String("c43cc1df-fc64-43a6-ad10-c9fadfdae457")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}) node_id = 17 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
79092026-03-03T16:56:51.640ZDEBGtest_metrics (SEC): saga log event new_state = N018 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
79102026-03-03T16:56:51.641ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 18 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
79112026-03-03T16:56:51.643ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79122026-03-03T16:56:51.643ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79132026-03-03T16:56:51.644ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79142026-03-03T16:56:51.646ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79152026-03-03T16:56:51.646ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79162026-03-03T16:56:51.646ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79172026-03-03T16:56:51.648ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79182026-03-03T16:56:51.648ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79192026-03-03T16:56:51.648ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79202026-03-03T16:56:51.649ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ById(1ce5f420-4363-42e9-8d76-1783996da352) }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79212026-03-03T16:56:51.649ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79222026-03-03T16:56:51.649ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79232026-03-03T16:56:51.650ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79242026-03-03T16:56:51.650ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79252026-03-03T16:56:51.683ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79262026-03-03T16:56:51.685ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79272026-03-03T16:56:51.685ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79282026-03-03T16:56:51.685ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79292026-03-03T16:56:51.692ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
79302026-03-03T16:56:51.692ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79312026-03-03T16:56:51.692ZDEBGtest_metrics (results-sink-cluster): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79322026-03-03T16:56:51.697ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79332026-03-03T16:56:51.699ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79342026-03-03T16:56:51.699ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79352026-03-03T16:56:51.699ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79362026-03-03T16:56:51.699ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79372026-03-03T16:56:51.710ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ById(1ce5f420-4363-42e9-8d76-1783996da352) }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79382026-03-03T16:56:51.712ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ById(1ce5f420-4363-42e9-8d76-1783996da352) }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79392026-03-03T16:56:51.712ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79402026-03-03T16:56:51.712ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79412026-03-03T16:56:51.712ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79422026-03-03T16:56:51.712ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79432026-03-03T16:56:51.714ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79442026-03-03T16:56:51.714ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79452026-03-03T16:56:51.714ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79462026-03-03T16:56:51.714ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79472026-03-03T16:56:51.717ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79482026-03-03T16:56:51.717ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79492026-03-03T16:56:51.717ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79502026-03-03T16:56:51.718ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79512026-03-03T16:56:51.721ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79522026-03-03T16:56:51.748ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ById(1ce5f420-4363-42e9-8d76-1783996da352) }, key: 164edcf0-af21-4153-9d5d-062b82786cd6, lookup_type: ByName("default") } result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79532026-03-03T16:56:51.749ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79542026-03-03T16:56:51.749ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79552026-03-03T16:56:51.749ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79562026-03-03T16:56:51.757ZDEBGtest_metrics (nexus): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
79572026-03-03T16:56:51.758ZDEBGtest_metrics (nexus): resolved firewall rules for sled agents sled_agent_rules = []
79582026-03-03T16:56:51.758ZDEBGtest_metrics (nexus): resolved 0 rules for sleds
79592026-03-03T16:56:51.793ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
79602026-03-03T16:56:51.795ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79612026-03-03T16:56:51.807ZDEBGtest_metrics (nexus): resolved sleds for vpc default vpc_to_sled = []
79622026-03-03T16:56:51.807ZDEBGtest_metrics (nexus): sending firewall rules to sled agents
79632026-03-03T16:56:51.807ZINFOtest_metrics (nexus): updated firewall rules on 0 sleds
79642026-03-03T16:56:51.807ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79652026-03-03T16:56:51.807ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79662026-03-03T16:56:51.808ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
79672026-03-03T16:56:51.810ZDEBGtest_metrics (SEC): saga log event new_state = N018 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
79682026-03-03T16:56:51.810ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
79692026-03-03T16:56:51.811ZDEBGtest_metrics (SEC): saga log event new_state = N019 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
79702026-03-03T16:56:51.813ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 19 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
79712026-03-03T16:56:51.813ZDEBGtest_metrics (SEC): saga log event new_state = N019 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
79722026-03-03T16:56:51.813ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
79732026-03-03T16:56:51.816ZDEBGtest_metrics (SEC): saga log event new_state = N021 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
79742026-03-03T16:56:51.816ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 21 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
79752026-03-03T16:56:51.817ZDEBGtest_metrics (SEC): saga log event new_state = N021 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
79762026-03-03T16:56:51.817ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 21 saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
79772026-03-03T16:56:51.819ZINFOtest_metrics (SEC): update for saga cached state new_state = Done saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b sec_id = 913233fe-92a8-4635-9572-183f495429c4
79782026-03-03T16:56:51.819ZINFOtest_metrics (SecStore): updating state new_state = done saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
79792026-03-03T16:56:51.869ZINFOtest_metrics (SEC): saga finished result = success saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
79802026-03-03T16:56:51.869ZINFOtest_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b
79812026-03-03T16:56:51.869ZINFOtest_metrics (SagaExecutor): saga finished saga_id = 4014fb9d-f0a3-46f1-8140-753a1b241c5b saga_name = project-create saga_result = SagaResult { saga_id: 4014fb9d-f0a3-46f1-8140-753a1b241c5b, saga_log: SagaLog { saga_id: 4014fb9d-f0a3-46f1-8140-753a1b241c5b, unwinding: false, events: [N020 started, N020 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N018 started, N018 succeeded, N019 started, N019 succeeded, N021 started, N021 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("1ce5f420-4363-42e9-8d76-1783996da352"), "name": String("p-2"), "time_created": String("2026-03-03T16:56:51.221293Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.221293Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd0a:9f1d:e998::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("164edcf0-af21-4153-9d5d-062b82786cd6")), 4: Succeeded(String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c")), 5: Succeeded(String("2f6656e9-444c-4aff-864e-b8a58bfbe714")), 6: Succeeded(String("98c2c113-b0e6-4676-ba17-1be56559785f")), 7: Succeeded(String("938516fc-298f-4896-a190-40504168530f")), 8: Succeeded(String("8c18134b-e3b1-4b36-bb1c-47f9d50394df")), 9: Succeeded(String("c43cc1df-fc64-43a6-ad10-c9fadfdae457")), 10: Succeeded(Array [Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "name": String("default"), "time_created": String("2026-03-03T16:56:51.293869Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.293869Z")}, "ipv6_prefix": String("fd0a:9f1d:e998::/48"), "project_id": String("1ce5f420-4363-42e9-8d76-1783996da352"), "subnet_gen": Number(1), "system_router_id": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c"), "vni": Number(16597712)}]), 11: Succeeded(Object {"key": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c"), "lookup_type": Object {"ById": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Array [Object {"key": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df"), "lookup_type": Object {"ById": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df"), "name": String("default"), "time_created": String("2026-03-03T16:56:51.406979Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.406979Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd0a:9f1d:e998::/64"), "rcgen": Number(1), "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}]), 15: Succeeded(Object {"key": String("938516fc-298f-4896-a190-40504168530f"), "lookup_type": Object {"ById": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df")}, "parent": Object {"key": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c"), "lookup_type": Object {"ById": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}), 16: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("ba66728c-191f-423d-935d-a0b022500970"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T16:56:51.461536Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.461536Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("60f95435-dc8a-4333-b865-b4174b9caa2c"), "name": String("allow-ssh"), "time_created": String("2026-03-03T16:56:51.461553Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.461553Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("6c9b7b14-6c8c-40cd-8395-4655a800565c"), "name": String("allow-icmp"), "time_created": String("2026-03-03T16:56:51.461559Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.461559Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}]), 17: Succeeded(Object {"key": String("c43cc1df-fc64-43a6-ad10-c9fadfdae457"), "lookup_type": Object {"ById": String("c43cc1df-fc64-43a6-ad10-c9fadfdae457")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}), 18: Succeeded(Null), 19: Succeeded(Null), 20: Succeeded(Null), 21: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("c43cc1df-fc64-43a6-ad10-c9fadfdae457"), "default_subnet_id": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df"), "default_v4_route_id": String("2f6656e9-444c-4aff-864e-b8a58bfbe714"), "default_v6_route_id": String("98c2c113-b0e6-4676-ba17-1be56559785f"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("ba66728c-191f-423d-935d-a0b022500970"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T16:56:51.461536Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.461536Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("60f95435-dc8a-4333-b865-b4174b9caa2c"), "name": String("allow-ssh"), "time_created": String("2026-03-03T16:56:51.461553Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.461553Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("6c9b7b14-6c8c-40cd-8395-4655a800565c"), "name": String("allow-icmp"), "time_created": String("2026-03-03T16:56:51.461559Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.461559Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}], "gateway": Object {"key": String("c43cc1df-fc64-43a6-ad10-c9fadfdae457"), "lookup_type": Object {"ById": String("c43cc1df-fc64-43a6-ad10-c9fadfdae457")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("1ce5f420-4363-42e9-8d76-1783996da352"), "name": String("p-2"), "time_created": String("2026-03-03T16:56:51.221293Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.221293Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}], "route": Object {"key": String("938516fc-298f-4896-a190-40504168530f"), "lookup_type": Object {"ById": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df")}, "parent": Object {"key": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c"), "lookup_type": Object {"ById": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}, "route4": Null, "route6": Null, "router": Object {"key": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c"), "lookup_type": Object {"ById": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df"), "lookup_type": Object {"ById": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df")}, "parent": Object {"key": String("164edcf0-af21-4153-9d5d-062b82786cd6"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("8c18134b-e3b1-4b36-bb1c-47f9d50394df"), "name": String("default"), "time_created": String("2026-03-03T16:56:51.406979Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:51.406979Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd0a:9f1d:e998::/64"), "rcgen": Number(1), "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")}], "subnet_route_id": String("938516fc-298f-4896-a190-40504168530f"), "system_router_id": String("9ac5f9fa-5fbd-4399-b0a3-97563c45f94c"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("1ce5f420-4363-42e9-8d76-1783996da352"), "lookup_type": Object {"ByName": String("p-2")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd0a:9f1d:e998::/48"), "name": String("default")}}, "vpc_id": String("164edcf0-af21-4153-9d5d-062b82786cd6")} }) }
79822026-03-03T16:56:51.869ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
79832026-03-03T16:56:51.869ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
79842026-03-03T16:56:51.869ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
79852026-03-03T16:56:51.869ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
79862026-03-03T16:56:51.869ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
79872026-03-03T16:56:51.874ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
79882026-03-03T16:56:51.874ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
79892026-03-03T16:56:51.874ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
79902026-03-03T16:56:51.874ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
79912026-03-03T16:56:51.874ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
79922026-03-03T16:56:51.876ZINFOtest_metrics (dropshot_external): request completed latency_us = 764559 local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = cfa772ba-9b0b-4e3e-8d14-63096f6224cc response_code = 201 uri = /v1/projects
79932026-03-03T16:56:51.876ZINFOtest_metrics (external client test context): client received response status = 201
79942026-03-03T16:56:51.877ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
79952026-03-03T16:56:51.877ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
79962026-03-03T16:56:51.877ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
79972026-03-03T16:56:51.877ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
79982026-03-03T16:56:51.877ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
79992026-03-03T16:56:51.877ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
80002026-03-03T16:56:51.877ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
80012026-03-03T16:56:51.877ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80022026-03-03T16:56:51.877ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352 version = 2026021900.0.0
80032026-03-03T16:56:51.877ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 43ebc03e-aa5e-4623-9562-dc02ade297b9 uri = /913233fe-92a8-4635-9572-183f495429c4
80042026-03-03T16:56:51.878ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80052026-03-03T16:56:51.878ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80062026-03-03T16:56:51.878ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80072026-03-03T16:56:51.878ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80082026-03-03T16:56:51.878ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80092026-03-03T16:56:51.885ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7204 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 43ebc03e-aa5e-4623-9562-dc02ade297b9 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
80102026-03-03T16:56:51.885ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
80112026-03-03T16:56:51.892ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
80122026-03-03T16:56:51.892ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
80132026-03-03T16:56:51.892ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
80142026-03-03T16:56:51.892ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
80152026-03-03T16:56:51.896ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
80162026-03-03T16:56:51.896ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
80172026-03-03T16:56:51.896ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
80182026-03-03T16:56:51.896ZDEBGtest_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
80192026-03-03T16:56:51.896ZDEBGtest_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
80202026-03-03T16:56:51.902ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 26 sql = INSERT INTO oximeter.fields_string FORMAT Native
80212026-03-03T16:56:51.904ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
80222026-03-03T16:56:51.904ZDEBGtest_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
80232026-03-03T16:56:51.904ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80242026-03-03T16:56:51.904ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80252026-03-03T16:56:51.905ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80262026-03-03T16:56:51.906ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 26 table_name = fields_string
80272026-03-03T16:56:51.906ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
80282026-03-03T16:56:51.907ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = fields_u16
80292026-03-03T16:56:51.907ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
80302026-03-03T16:56:51.907ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
80312026-03-03T16:56:51.907ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
80322026-03-03T16:56:51.907ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80332026-03-03T16:56:51.907ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80342026-03-03T16:56:51.908ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80352026-03-03T16:56:51.909ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_uuid
80362026-03-03T16:56:51.910ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
80372026-03-03T16:56:51.910ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
80382026-03-03T16:56:51.910ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80392026-03-03T16:56:51.910ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80402026-03-03T16:56:51.911ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80412026-03-03T16:56:51.912ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = measurements_histogramu64
80422026-03-03T16:56:51.912ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 4 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
80432026-03-03T16:56:51.912ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
80442026-03-03T16:56:51.922ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
80452026-03-03T16:56:51.922ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80462026-03-03T16:56:51.922ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80472026-03-03T16:56:51.922ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80482026-03-03T16:56:51.922ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 4 table_name = measurements_i64
80492026-03-03T16:56:51.922ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
80502026-03-03T16:56:51.922ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
80512026-03-03T16:56:51.922ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
80522026-03-03T16:56:51.922ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
80532026-03-03T16:56:51.931ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
80542026-03-03T16:56:51.931ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
80552026-03-03T16:56:51.932ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
80562026-03-03T16:56:51.932ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
80572026-03-03T16:56:51.932ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80582026-03-03T16:56:51.932ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80592026-03-03T16:56:51.933ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80602026-03-03T16:56:51.944ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
80612026-03-03T16:56:51.944ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80622026-03-03T16:56:51.944ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80632026-03-03T16:56:51.944ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80642026-03-03T16:56:51.944ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
80652026-03-03T16:56:51.944ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
80662026-03-03T16:56:51.944ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80672026-03-03T16:56:51.944ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80682026-03-03T16:56:51.944ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80692026-03-03T16:56:51.944ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80702026-03-03T16:56:51.944ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80712026-03-03T16:56:51.945ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80722026-03-03T16:56:51.946ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
80732026-03-03T16:56:51.946ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
80742026-03-03T16:56:51.948ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80752026-03-03T16:56:51.948ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80762026-03-03T16:56:51.948ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80772026-03-03T16:56:51.948ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80782026-03-03T16:56:51.950ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80792026-03-03T16:56:51.952ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80802026-03-03T16:56:51.954ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80812026-03-03T16:56:51.954ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80822026-03-03T16:56:51.954ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80832026-03-03T16:56:51.955ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80842026-03-03T16:56:51.955ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80852026-03-03T16:56:51.955ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80862026-03-03T16:56:51.957ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ById(1ce5f420-4363-42e9-8d76-1783996da352) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80872026-03-03T16:56:51.958ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80882026-03-03T16:56:51.958ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80892026-03-03T16:56:51.958ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80902026-03-03T16:56:51.958ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80912026-03-03T16:56:51.959ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80922026-03-03T16:56:51.959ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80932026-03-03T16:56:51.959ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80942026-03-03T16:56:51.959ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80952026-03-03T16:56:51.961ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80962026-03-03T16:56:51.961ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80972026-03-03T16:56:51.961ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80982026-03-03T16:56:51.962ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
80992026-03-03T16:56:51.963ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81002026-03-03T16:56:51.974ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ById(1ce5f420-4363-42e9-8d76-1783996da352) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81012026-03-03T16:56:51.974ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81022026-03-03T16:56:51.974ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81032026-03-03T16:56:51.974ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81042026-03-03T16:56:51.974ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81052026-03-03T16:56:51.974ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81062026-03-03T16:56:51.976ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81072026-03-03T16:56:51.976ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81082026-03-03T16:56:51.976ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81092026-03-03T16:56:51.977ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81102026-03-03T16:56:51.979ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81112026-03-03T16:56:51.981ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81122026-03-03T16:56:51.982ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '1ce5f420-4363-42e9-8d76-1783996da352') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
81132026-03-03T16:56:51.987ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (15953619517489503133) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:51.877104369' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
81142026-03-03T16:56:51.988ZINFOtest_metrics (dropshot_external): request completed latency_us = 110876 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = e82d6d7c-6b8e-4fc0-8260-4c40be5cfef0 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.877104369Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81152026-03-03T16:56:51.989ZINFOtest_metrics (external client test context): client received response status = 200
81162026-03-03T16:56:51.989ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81172026-03-03T16:56:51.989ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
81182026-03-03T16:56:51.989ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
81192026-03-03T16:56:51.989ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
81202026-03-03T16:56:51.989ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
81212026-03-03T16:56:51.989ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
81222026-03-03T16:56:51.990ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
81232026-03-03T16:56:51.990ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81242026-03-03T16:56:51.990ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352 version = 2026021900.0.0
81252026-03-03T16:56:51.990ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = c6cb1974-2774-42ae-9569-0ee8abd4a55d uri = /913233fe-92a8-4635-9572-183f495429c4
81262026-03-03T16:56:51.990ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81272026-03-03T16:56:51.990ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81282026-03-03T16:56:51.990ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
81292026-03-03T16:56:51.990ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
81302026-03-03T16:56:51.992ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
81312026-03-03T16:56:51.998ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7435 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = c6cb1974-2774-42ae-9569-0ee8abd4a55d response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
81322026-03-03T16:56:51.998ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
81332026-03-03T16:56:52.006ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
81342026-03-03T16:56:52.007ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
81352026-03-03T16:56:52.007ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
81362026-03-03T16:56:52.007ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
81372026-03-03T16:56:52.007ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
81382026-03-03T16:56:52.007ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
81392026-03-03T16:56:52.007ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
81402026-03-03T16:56:52.007ZDEBGtest_metrics (results-sink): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
81412026-03-03T16:56:52.007ZDEBGtest_metrics (clickhouse-client): unrolling 12 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
81422026-03-03T16:56:52.012ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
81432026-03-03T16:56:52.012ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
81442026-03-03T16:56:52.012ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
81452026-03-03T16:56:52.013ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
81462026-03-03T16:56:52.014ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
81472026-03-03T16:56:52.014ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
81482026-03-03T16:56:52.014ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
81492026-03-03T16:56:52.015ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
81502026-03-03T16:56:52.015ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
81512026-03-03T16:56:52.015ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
81522026-03-03T16:56:52.015ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
81532026-03-03T16:56:52.017ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 24 table_name = fields_string
81542026-03-03T16:56:52.017ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
81552026-03-03T16:56:52.018ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
81562026-03-03T16:56:52.018ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
81572026-03-03T16:56:52.018ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
81582026-03-03T16:56:52.018ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
81592026-03-03T16:56:52.020ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = fields_u16
81602026-03-03T16:56:52.020ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
81612026-03-03T16:56:52.021ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = fields_uuid
81622026-03-03T16:56:52.021ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
81632026-03-03T16:56:52.021ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
81642026-03-03T16:56:52.023ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
81652026-03-03T16:56:52.023ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
81662026-03-03T16:56:52.023ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
81672026-03-03T16:56:52.023ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
81682026-03-03T16:56:52.025ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
81692026-03-03T16:56:52.025ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
81702026-03-03T16:56:52.025ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
81712026-03-03T16:56:52.025ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
81722026-03-03T16:56:52.030ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
81732026-03-03T16:56:52.031ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = measurements_histogramu64
81742026-03-03T16:56:52.031ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
81752026-03-03T16:56:52.031ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
81762026-03-03T16:56:52.032ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
81772026-03-03T16:56:52.032ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
81782026-03-03T16:56:52.036ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
81792026-03-03T16:56:52.036ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
81802026-03-03T16:56:52.036ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
81812026-03-03T16:56:52.036ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
81822026-03-03T16:56:52.037ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
81832026-03-03T16:56:52.037ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
81842026-03-03T16:56:52.039ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
81852026-03-03T16:56:52.041ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
81862026-03-03T16:56:52.041ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81872026-03-03T16:56:52.041ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81882026-03-03T16:56:52.041ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81892026-03-03T16:56:52.041ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81902026-03-03T16:56:52.041ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81912026-03-03T16:56:52.041ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81922026-03-03T16:56:52.044ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81932026-03-03T16:56:52.045ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81942026-03-03T16:56:52.045ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81952026-03-03T16:56:52.045ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81962026-03-03T16:56:52.046ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
81972026-03-03T16:56:52.046ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
81982026-03-03T16:56:52.047ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
81992026-03-03T16:56:52.049ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82002026-03-03T16:56:52.049ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82012026-03-03T16:56:52.049ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82022026-03-03T16:56:52.049ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82032026-03-03T16:56:52.054ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82042026-03-03T16:56:52.054ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82052026-03-03T16:56:52.054ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82062026-03-03T16:56:52.057ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ById(1ce5f420-4363-42e9-8d76-1783996da352) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82072026-03-03T16:56:52.057ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82082026-03-03T16:56:52.057ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82092026-03-03T16:56:52.057ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82102026-03-03T16:56:52.057ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82112026-03-03T16:56:52.059ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82122026-03-03T16:56:52.059ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82132026-03-03T16:56:52.059ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82142026-03-03T16:56:52.060ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82152026-03-03T16:56:52.069ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82162026-03-03T16:56:52.069ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82172026-03-03T16:56:52.069ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82182026-03-03T16:56:52.070ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82192026-03-03T16:56:52.072ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82202026-03-03T16:56:52.078ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ById(1ce5f420-4363-42e9-8d76-1783996da352) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82212026-03-03T16:56:52.078ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82222026-03-03T16:56:52.078ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82232026-03-03T16:56:52.078ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82242026-03-03T16:56:52.078ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82252026-03-03T16:56:52.079ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82262026-03-03T16:56:52.080ZTRACtest_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 34 84 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 4............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:56275 req_id = fbf97240-577d-4d6e-a542-b17f37e887ec
82272026-03-03T16:56:52.080ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 13444,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:56275 req_id = fbf97240-577d-4d6e-a542-b17f37e887ec
82282026-03-03T16:56:52.081ZDEBGtest_metrics (store): query key key = _mgs._tcp
82292026-03-03T16:56:52.081ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
82302026-03-03T16:56:52.081ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:56275 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 36753, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = fbf97240-577d-4d6e-a542-b17f37e887ec
82312026-03-03T16:56:52.081ZTRACtest_metrics (dns): buffer buffer = Length: 74 (0x4a) bytes\n0000: 19 49 01 00 00 01 00 00 00 00 00 01 0b 5f 72 65 .I..........._re\n0010: 70 6f 2d 64 65 70 6f 74 04 5f 74 63 70 0d 63 6f po-depot._tcp.co\n0020: 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 ntrol-plane.oxid\n0030: 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 e.internal..!...\n0040: 00 29 04 d0 00 00 00 00 00 00 .)........ kind = dns peer_addr = [::1]:61752 req_id = 08ac6f2d-20c7-4e01-a181-8067c6dbb267
82322026-03-03T16:56:52.081ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 6473,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_repo-depot._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_repo-depot._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 11,\n 95,\n 114,\n 101,\n 112,\n 111,\n 45,\n 100,\n 101,\n 112,\n 111,\n 116,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:61752 req_id = 08ac6f2d-20c7-4e01-a181-8067c6dbb267
82332026-03-03T16:56:52.081ZDEBGtest_metrics (store): query key key = _repo-depot._tcp
82342026-03-03T16:56:52.081ZDEBGtest_metrics (store): query key key = b6d65341-167c-41df-9b5c-41cded99c229.sled
82352026-03-03T16:56:52.081ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:61752 query = LowerQuery { name: LowerName(Name("_repo-depot._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_repo-depot._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_repo-depot._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 33671, target: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal") }) }] req_id = 08ac6f2d-20c7-4e01-a181-8067c6dbb267
82362026-03-03T16:56:52.081ZTRACtest_metrics (dns): buffer buffer = Length: 79 (0x4f) bytes\n0000: 76 60 01 00 00 01 00 00 00 00 00 01 10 5f 63 72 v`..........._cr\n0010: 75 63 69 62 6c 65 2d 70 61 6e 74 72 79 04 5f 74 ucible-pantry._t\n0020: 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 cp.control-plane\n0030: 05 6f 78 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 .oxide.internal.\n0040: 00 21 00 01 00 00 29 04 d0 00 00 00 00 00 00 .!....)........ kind = dns peer_addr = [::1]:53054 req_id = d20a85dc-50f5-4651-bbe0-e72d99c10e82
82372026-03-03T16:56:52.081ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 30304,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 16,\n 95,\n 99,\n 114,\n 117,\n 99,\n 105,\n 98,\n 108,\n 101,\n 45,\n 112,\n 97,\n 110,\n 116,\n 114,\n 121,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:53054 req_id = d20a85dc-50f5-4651-bbe0-e72d99c10e82
82382026-03-03T16:56:52.081ZDEBGtest_metrics (store): query key key = _crucible-pantry._tcp
82392026-03-03T16:56:52.081ZDEBGtest_metrics (store): query key key = 79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host
82402026-03-03T16:56:52.081ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:53054 query = LowerQuery { name: LowerName(Name("_crucible-pantry._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 44387, target: Name("79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host.control-plane.oxide.internal") }) }] req_id = d20a85dc-50f5-4651-bbe0-e72d99c10e82
82412026-03-03T16:56:52.082ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82422026-03-03T16:56:52.082ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82432026-03-03T16:56:52.082ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82442026-03-03T16:56:52.082ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82452026-03-03T16:56:52.089ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: ab 8c 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:62640 req_id = 5fd30652-83a1-4217-90ed-901709a51cfb
82462026-03-03T16:56:52.089ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 43916,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:62640 req_id = 5fd30652-83a1-4217-90ed-901709a51cfb
82472026-03-03T16:56:52.089ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
82482026-03-03T16:56:52.089ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:62640 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 5fd30652-83a1-4217-90ed-901709a51cfb
82492026-03-03T16:56:52.089ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 79 92 01 00 00 01 00 00 00 00 00 01 24 62 36 64 y...........$b6d\n0010: 36 35 33 34 31 2d 31 36 37 63 2d 34 31 64 66 2d 65341-167c-41df-\n0020: 39 62 35 63 2d 34 31 63 64 65 64 39 39 63 32 32 9b5c-41cded99c22\n0030: 39 04 73 6c 65 64 0d 63 6f 6e 74 72 6f 6c 2d 70 9.sled.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:63054 req_id = 04fd988f-f41f-4043-85f1-b59b36d92092
82502026-03-03T16:56:52.089ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 31122,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 115,\n 108,\n 101,\n 100,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:63054 req_id = 04fd988f-f41f-4043-85f1-b59b36d92092
82512026-03-03T16:56:52.089ZDEBGtest_metrics (store): query key key = b6d65341-167c-41df-9b5c-41cded99c229.sled
82522026-03-03T16:56:52.089ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:63054 query = LowerQuery { name: LowerName(Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal.")), original: Query { name: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 04fd988f-f41f-4043-85f1-b59b36d92092
82532026-03-03T16:56:52.089ZTRACtest_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 7e 22 01 00 00 01 00 00 00 00 00 01 24 37 39 63 ~"..........$79c\n0010: 61 65 36 63 30 2d 62 38 64 34 2d 34 66 33 66 2d ae6c0-b8d4-4f3f-\n0020: 61 65 35 34 2d 37 66 30 34 39 37 32 35 32 63 30 ae54-7f0497252c0\n0030: 64 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 d.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:58176 req_id = da5a67ef-0f10-467d-89a9-b4cbc1ffb159
82542026-03-03T16:56:52.089ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 32290,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 55,\n 57,\n 99,\n 97,\n 101,\n 54,\n 99,\n 48,\n 45,\n 98,\n 56,\n 100,\n 52,\n 45,\n 52,\n 102,\n 51,\n 102,\n 45,\n 97,\n 101,\n 53,\n 52,\n 45,\n 55,\n 102,\n 48,\n 52,\n 57,\n 55,\n 50,\n 53,\n 50,\n 99,\n 48,\n 100,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:58176 req_id = da5a67ef-0f10-467d-89a9-b4cbc1ffb159
82552026-03-03T16:56:52.089ZDEBGtest_metrics (store): query key key = 79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host
82562026-03-03T16:56:52.089ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:58176 query = LowerQuery { name: LowerName(Name("79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host.control-plane.oxide.internal.")), original: Query { name: Name("79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("79cae6c0-b8d4-4f3f-ae54-7f0497252c0d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = da5a67ef-0f10-467d-89a9-b4cbc1ffb159
82572026-03-03T16:56:52.108ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82582026-03-03T16:56:52.110ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82592026-03-03T16:56:52.112ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '1ce5f420-4363-42e9-8d76-1783996da352') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
82602026-03-03T16:56:52.112ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:44387 remote_addr = [::1]:44728 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
82612026-03-03T16:56:52.113ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:44387 method = GET remote_addr = [::1]:44728 req_id = cc97073b-28d5-49e8-a30d-be528af3d952 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82622026-03-03T16:56:52.113ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 174 local_addr = [::1]:44387 method = GET remote_addr = [::1]:44728 req_id = cc97073b-28d5-49e8-a30d-be528af3d952 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82632026-03-03T16:56:52.242ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (4721039789300010539) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:51.989250177' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
82642026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:44387 remote_addr = [::1]:44730 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
82652026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:44387 remote_addr = [::1]:44732 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
82662026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:44387 remote_addr = [::1]:44734 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
82672026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:44387 remote_addr = [::1]:44736 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
82682026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:44387 remote_addr = [::1]:44738 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
82692026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:44387 remote_addr = [::1]:44740 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
82702026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:44387 remote_addr = [::1]:44742 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
82712026-03-03T16:56:52.244ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
82722026-03-03T16:56:52.244ZDEBGtest_metrics (results-sink-cluster): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
82732026-03-03T16:56:52.244ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:44387 method = GET remote_addr = [::1]:44730 req_id = 9f7755fb-5e27-4c06-8b9b-35e2638f68a9 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82742026-03-03T16:56:52.244ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:44387 method = GET remote_addr = [::1]:44732 req_id = 34d3743d-0aac-47a0-ae8f-386a95936394 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82752026-03-03T16:56:52.244ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:44387 method = GET remote_addr = [::1]:44734 req_id = b6458e5e-0e00-4ffa-853e-67100a263eb1 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82762026-03-03T16:56:52.244ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:44387 method = GET remote_addr = [::1]:44736 req_id = 65341c2f-3ee4-4f47-b9c7-0fcdced745d5 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82772026-03-03T16:56:52.244ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:44387 method = GET remote_addr = [::1]:44738 req_id = f2c65b4e-c8dc-422e-898f-83d616eac279 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82782026-03-03T16:56:52.244ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:44387 method = GET remote_addr = [::1]:44740 req_id = 2a600480-4f09-480b-ac34-e5d0d5120dba sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82792026-03-03T16:56:52.244ZTRACtest_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:44387 method = GET remote_addr = [::1]:44742 req_id = 8c9b9c2b-8ece-445c-a7b0-33c7042e9d48 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82802026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 311 local_addr = [::1]:44387 method = GET remote_addr = [::1]:44730 req_id = 9f7755fb-5e27-4c06-8b9b-35e2638f68a9 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82812026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 284 local_addr = [::1]:44387 method = GET remote_addr = [::1]:44732 req_id = 34d3743d-0aac-47a0-ae8f-386a95936394 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82822026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 271 local_addr = [::1]:44387 method = GET remote_addr = [::1]:44734 req_id = b6458e5e-0e00-4ffa-853e-67100a263eb1 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82832026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 263 local_addr = [::1]:44387 method = GET remote_addr = [::1]:44736 req_id = 65341c2f-3ee4-4f47-b9c7-0fcdced745d5 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82842026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 254 local_addr = [::1]:44387 method = GET remote_addr = [::1]:44738 req_id = f2c65b4e-c8dc-422e-898f-83d616eac279 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82852026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 245 local_addr = [::1]:44387 method = GET remote_addr = [::1]:44740 req_id = 2a600480-4f09-480b-ac34-e5d0d5120dba response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82862026-03-03T16:56:52.244ZINFOtest_metrics (dropshot): request completed kind = pantry latency_us = 236 local_addr = [::1]:44387 method = GET remote_addr = [::1]:44742 req_id = 8c9b9c2b-8ece-445c-a7b0-33c7042e9d48 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
82872026-03-03T16:56:52.245ZINFOtest_metrics (dropshot_external): request completed latency_us = 255292 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7eef41aa-9ccf-4d08-92c6-edac7b494730 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:51.989250177Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82882026-03-03T16:56:52.246ZINFOtest_metrics (external client test context): client received response status = 200
82892026-03-03T16:56:52.246ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82902026-03-03T16:56:52.246ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
82912026-03-03T16:56:52.246ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
82922026-03-03T16:56:52.246ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
82932026-03-03T16:56:52.246ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
82942026-03-03T16:56:52.246ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
82952026-03-03T16:56:52.246ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
82962026-03-03T16:56:52.246ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
82972026-03-03T16:56:52.246ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352 version = 2026021900.0.0
82982026-03-03T16:56:52.246ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = eb24bc0b-ac46-4575-9795-55117ff0dd0d uri = /913233fe-92a8-4635-9572-183f495429c4
82992026-03-03T16:56:52.247ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83002026-03-03T16:56:52.247ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83012026-03-03T16:56:52.247ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
83022026-03-03T16:56:52.247ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
83032026-03-03T16:56:52.247ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
83042026-03-03T16:56:52.253ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6280 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = eb24bc0b-ac46-4575-9795-55117ff0dd0d response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
83052026-03-03T16:56:52.253ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
83062026-03-03T16:56:52.262ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
83072026-03-03T16:56:52.262ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
83082026-03-03T16:56:52.262ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
83092026-03-03T16:56:52.262ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
83102026-03-03T16:56:52.262ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
83112026-03-03T16:56:52.262ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
83122026-03-03T16:56:52.262ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
83132026-03-03T16:56:52.262ZDEBGtest_metrics (results-sink): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
83142026-03-03T16:56:52.263ZDEBGtest_metrics (clickhouse-client): unrolling 12 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
83152026-03-03T16:56:52.264ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
83162026-03-03T16:56:52.266ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 24 table_name = fields_string
83172026-03-03T16:56:52.266ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
83182026-03-03T16:56:52.267ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = fields_u16
83192026-03-03T16:56:52.267ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
83202026-03-03T16:56:52.267ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
83212026-03-03T16:56:52.268ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
83222026-03-03T16:56:52.268ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
83232026-03-03T16:56:52.270ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = fields_uuid
83242026-03-03T16:56:52.271ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
83252026-03-03T16:56:52.271ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
83262026-03-03T16:56:52.271ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
83272026-03-03T16:56:52.271ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
83282026-03-03T16:56:52.271ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
83292026-03-03T16:56:52.275ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
83302026-03-03T16:56:52.279ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 12 table_name = measurements_histogramu64
83312026-03-03T16:56:52.279ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
83322026-03-03T16:56:52.279ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
83332026-03-03T16:56:52.279ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
83342026-03-03T16:56:52.279ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
83352026-03-03T16:56:52.279ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
83362026-03-03T16:56:52.280ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
83372026-03-03T16:56:52.280ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
83382026-03-03T16:56:52.280ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
83392026-03-03T16:56:52.286ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
83402026-03-03T16:56:52.286ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
83412026-03-03T16:56:52.286ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
83422026-03-03T16:56:52.286ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
83432026-03-03T16:56:52.286ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
83442026-03-03T16:56:52.286ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
83452026-03-03T16:56:52.286ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
83462026-03-03T16:56:52.288ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
83472026-03-03T16:56:52.288ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
83482026-03-03T16:56:52.288ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
83492026-03-03T16:56:52.288ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
83502026-03-03T16:56:52.288ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
83512026-03-03T16:56:52.289ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
83522026-03-03T16:56:52.289ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
83532026-03-03T16:56:52.289ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
83542026-03-03T16:56:52.289ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
83552026-03-03T16:56:52.289ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
83562026-03-03T16:56:52.289ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
83572026-03-03T16:56:52.291ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
83582026-03-03T16:56:52.293ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
83592026-03-03T16:56:52.293ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83602026-03-03T16:56:52.293ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83612026-03-03T16:56:52.293ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83622026-03-03T16:56:52.293ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83632026-03-03T16:56:52.293ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83642026-03-03T16:56:52.293ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83652026-03-03T16:56:52.300ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83662026-03-03T16:56:52.300ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83672026-03-03T16:56:52.300ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83682026-03-03T16:56:52.300ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83692026-03-03T16:56:52.302ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83702026-03-03T16:56:52.304ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83712026-03-03T16:56:52.304ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83722026-03-03T16:56:52.304ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83732026-03-03T16:56:52.305ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83742026-03-03T16:56:52.306ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83752026-03-03T16:56:52.306ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83762026-03-03T16:56:52.307ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83772026-03-03T16:56:52.308ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ById(1ce5f420-4363-42e9-8d76-1783996da352) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83782026-03-03T16:56:52.308ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource_id = 1ce5f420-4363-42e9-8d76-1783996da352 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83792026-03-03T16:56:52.308ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83802026-03-03T16:56:52.308ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83812026-03-03T16:56:52.309ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83822026-03-03T16:56:52.315ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83832026-03-03T16:56:52.315ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83842026-03-03T16:56:52.315ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83852026-03-03T16:56:52.315ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83862026-03-03T16:56:52.317ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83872026-03-03T16:56:52.318ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83882026-03-03T16:56:52.318ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83892026-03-03T16:56:52.318ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83902026-03-03T16:56:52.320ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83912026-03-03T16:56:52.325ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 1ce5f420-4363-42e9-8d76-1783996da352, lookup_type: ById(1ce5f420-4363-42e9-8d76-1783996da352) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83922026-03-03T16:56:52.325ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83932026-03-03T16:56:52.325ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83942026-03-03T16:56:52.325ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83952026-03-03T16:56:52.325ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83962026-03-03T16:56:52.325ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83972026-03-03T16:56:52.327ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83982026-03-03T16:56:52.327ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
83992026-03-03T16:56:52.327ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
84002026-03-03T16:56:52.328ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
84012026-03-03T16:56:52.332ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
84022026-03-03T16:56:52.333ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
84032026-03-03T16:56:52.335ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '1ce5f420-4363-42e9-8d76-1783996da352') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
84042026-03-03T16:56:52.337ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (5796922242188634264) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:52.246155155' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
84052026-03-03T16:56:52.339ZINFOtest_metrics (dropshot_external): request completed latency_us = 93096 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f1eaf375-1877-48dc-88e6-d63310e3fd1f response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.246155155Z&order=descending&limit=1&project=1ce5f420-4363-42e9-8d76-1783996da352
84062026-03-03T16:56:52.340ZINFOtest_metrics (external client test context): client received response status = 200
84072026-03-03T16:56:52.340ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84082026-03-03T16:56:52.340ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84092026-03-03T16:56:52.340ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
84102026-03-03T16:56:52.340ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84112026-03-03T16:56:52.340ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84122026-03-03T16:56:52.340ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84132026-03-03T16:56:52.340ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84142026-03-03T16:56:52.341ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84152026-03-03T16:56:52.342ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84162026-03-03T16:56:52.342ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84172026-03-03T16:56:52.343ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84182026-03-03T16:56:52.343ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
84192026-03-03T16:56:52.344ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
84202026-03-03T16:56:52.344ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
84212026-03-03T16:56:52.344ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
84222026-03-03T16:56:52.344ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84232026-03-03T16:56:52.344ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84242026-03-03T16:56:52.345ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84252026-03-03T16:56:52.346ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
84262026-03-03T16:56:52.346ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84272026-03-03T16:56:52.347ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84282026-03-03T16:56:52.347ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84292026-03-03T16:56:52.349ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
84302026-03-03T16:56:52.351ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
84312026-03-03T16:56:52.351ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84322026-03-03T16:56:52.351ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84332026-03-03T16:56:52.351ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84342026-03-03T16:56:52.353ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
84352026-03-03T16:56:52.353ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
84362026-03-03T16:56:52.353ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84372026-03-03T16:56:52.353ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84382026-03-03T16:56:52.353ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84392026-03-03T16:56:52.355ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
84402026-03-03T16:56:52.355ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84412026-03-03T16:56:52.355ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84422026-03-03T16:56:52.355ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84432026-03-03T16:56:52.356ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
84442026-03-03T16:56:52.358ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
84452026-03-03T16:56:52.358ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84462026-03-03T16:56:52.358ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84472026-03-03T16:56:52.358ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84482026-03-03T16:56:52.358ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84492026-03-03T16:56:52.358ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84502026-03-03T16:56:52.359ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84512026-03-03T16:56:52.360ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84522026-03-03T16:56:52.360ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84532026-03-03T16:56:52.361ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84542026-03-03T16:56:52.361ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84552026-03-03T16:56:52.363ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84562026-03-03T16:56:52.365ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84572026-03-03T16:56:52.365ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84582026-03-03T16:56:52.365ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84592026-03-03T16:56:52.365ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84602026-03-03T16:56:52.373ZINFOtest_metrics (dropshot_external): request completed error_message_external = not found: project with id "001de000-5110-4000-8000-000000000000" error_message_internal = not found: project with id "001de000-5110-4000-8000-000000000000" latency_us = 33166 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = b5454b96-f85e-4ef3-982d-f864610ccfb3 response_code = 404 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.340204344Z&order=descending&limit=1&project=001de000-5110-4000-8000-000000000000
84612026-03-03T16:56:52.374ZINFOtest_metrics (external client test context): client received response status = 404
84622026-03-03T16:56:52.374ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
84632026-03-03T16:56:52.374ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
84642026-03-03T16:56:52.374ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10 version = 2026021900.0.0
84652026-03-03T16:56:52.374ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
84662026-03-03T16:56:52.374ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
84672026-03-03T16:56:52.374ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84682026-03-03T16:56:52.374ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84692026-03-03T16:56:52.375ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84702026-03-03T16:56:52.378ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84712026-03-03T16:56:52.378ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84722026-03-03T16:56:52.379ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84732026-03-03T16:56:52.380ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
84742026-03-03T16:56:52.380ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
84752026-03-03T16:56:52.380ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84762026-03-03T16:56:52.380ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84772026-03-03T16:56:52.381ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84782026-03-03T16:56:52.382ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
84792026-03-03T16:56:52.382ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84802026-03-03T16:56:52.382ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84812026-03-03T16:56:52.383ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84822026-03-03T16:56:52.384ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
84832026-03-03T16:56:52.386ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
84842026-03-03T16:56:52.386ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84852026-03-03T16:56:52.386ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84862026-03-03T16:56:52.387ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84872026-03-03T16:56:52.388ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
84882026-03-03T16:56:52.388ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
84892026-03-03T16:56:52.388ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84902026-03-03T16:56:52.388ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84912026-03-03T16:56:52.389ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84922026-03-03T16:56:52.390ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
84932026-03-03T16:56:52.390ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
84942026-03-03T16:56:52.390ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
84952026-03-03T16:56:52.390ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
84962026-03-03T16:56:52.392ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
84972026-03-03T16:56:52.394ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
84982026-03-03T16:56:52.394ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
84992026-03-03T16:56:52.394ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85002026-03-03T16:56:52.394ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85012026-03-03T16:56:52.394ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85022026-03-03T16:56:52.394ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85032026-03-03T16:56:52.394ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85042026-03-03T16:56:52.396ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85052026-03-03T16:56:52.399ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85062026-03-03T16:56:52.399ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85072026-03-03T16:56:52.399ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85082026-03-03T16:56:52.399ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85092026-03-03T16:56:52.407ZINFOtest_metrics (dropshot_external): request completed error_message_external = not found: silo with id "41c1c314-b812-4fb3-ab31-28abfa63ce10" error_message_internal = not found: silo with id "41c1c314-b812-4fb3-ab31-28abfa63ce10" latency_us = 33319 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 04c521a7-5a1b-4532-bdbf-072b38534c7e response_code = 404 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:52.374127918Z&order=descending&limit=1&silo=41c1c314-b812-4fb3-ab31-28abfa63ce10
85102026-03-03T16:56:52.408ZINFOtest_metrics (external client test context): client received response status = 404
85112026-03-03T16:56:52.408ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:40151/v1/instances?project=p-1
85122026-03-03T16:56:52.408ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 uri = /v1/instances?project=p-1
85132026-03-03T16:56:52.408ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 uri = /v1/instances?project=p-1 version = 2026021900.0.0
85142026-03-03T16:56:52.409ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 uri = /v1/instances?project=p-1
85152026-03-03T16:56:52.409ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/instances?project=p-1
85162026-03-03T16:56:52.409ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85172026-03-03T16:56:52.409ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85182026-03-03T16:56:52.409ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85192026-03-03T16:56:52.411ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85202026-03-03T16:56:52.411ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85212026-03-03T16:56:52.411ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85222026-03-03T16:56:52.413ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
85232026-03-03T16:56:52.413ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
85242026-03-03T16:56:52.413ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85252026-03-03T16:56:52.413ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85262026-03-03T16:56:52.413ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85272026-03-03T16:56:52.414ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
85282026-03-03T16:56:52.414ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85292026-03-03T16:56:52.414ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85302026-03-03T16:56:52.415ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85312026-03-03T16:56:52.416ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
85322026-03-03T16:56:52.418ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
85332026-03-03T16:56:52.418ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85342026-03-03T16:56:52.418ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85352026-03-03T16:56:52.419ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85362026-03-03T16:56:52.420ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
85372026-03-03T16:56:52.420ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
85382026-03-03T16:56:52.420ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85392026-03-03T16:56:52.420ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85402026-03-03T16:56:52.420ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85412026-03-03T16:56:52.421ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
85422026-03-03T16:56:52.421ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85432026-03-03T16:56:52.421ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85442026-03-03T16:56:52.422ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85452026-03-03T16:56:52.423ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
85462026-03-03T16:56:52.425ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
85472026-03-03T16:56:52.425ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 uri = /v1/instances?project=p-1
85482026-03-03T16:56:52.425ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85492026-03-03T16:56:52.425ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85502026-03-03T16:56:52.425ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85512026-03-03T16:56:52.425ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85522026-03-03T16:56:52.426ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85532026-03-03T16:56:52.427ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85542026-03-03T16:56:52.429ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85552026-03-03T16:56:52.429ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85562026-03-03T16:56:52.429ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85572026-03-03T16:56:52.429ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85582026-03-03T16:56:52.431ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85592026-03-03T16:56:52.431ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85602026-03-03T16:56:52.432ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85612026-03-03T16:56:52.433ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85622026-03-03T16:56:52.433ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85632026-03-03T16:56:52.433ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85642026-03-03T16:56:52.435ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85652026-03-03T16:56:52.435ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85662026-03-03T16:56:52.435ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85672026-03-03T16:56:52.435ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85682026-03-03T16:56:52.435ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85692026-03-03T16:56:52.437ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85702026-03-03T16:56:52.437ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85712026-03-03T16:56:52.437ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85722026-03-03T16:56:52.437ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85732026-03-03T16:56:52.439ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85742026-03-03T16:56:52.439ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85752026-03-03T16:56:52.439ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85762026-03-03T16:56:52.439ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85772026-03-03T16:56:52.441ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85782026-03-03T16:56:52.445ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85792026-03-03T16:56:52.445ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85802026-03-03T16:56:52.445ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85812026-03-03T16:56:52.445ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85822026-03-03T16:56:52.446ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
85832026-03-03T16:56:52.446ZDEBGtest_metrics (results-sink-cluster): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
85842026-03-03T16:56:52.447ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85852026-03-03T16:56:52.447ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85862026-03-03T16:56:52.447ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85872026-03-03T16:56:52.448ZTRACtest_metrics (dropshot_external): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85882026-03-03T16:56:52.448ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85892026-03-03T16:56:52.448ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85902026-03-03T16:56:52.448ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85912026-03-03T16:56:52.449ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85922026-03-03T16:56:52.450ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85932026-03-03T16:56:52.450ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85942026-03-03T16:56:52.450ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85952026-03-03T16:56:52.451ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85962026-03-03T16:56:52.452ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85972026-03-03T16:56:52.454ZDEBGtest_metrics (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85982026-03-03T16:56:52.454ZTRACtest_metrics (dropshot_external): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
85992026-03-03T16:56:52.454ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86002026-03-03T16:56:52.454ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86012026-03-03T16:56:52.454ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86022026-03-03T16:56:52.454ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86032026-03-03T16:56:52.456ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86042026-03-03T16:56:52.456ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86052026-03-03T16:56:52.456ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86062026-03-03T16:56:52.456ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86072026-03-03T16:56:52.458ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86082026-03-03T16:56:52.459ZDEBGtest_metrics (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86092026-03-03T16:56:52.459ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86102026-03-03T16:56:52.459ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86112026-03-03T16:56:52.460ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86122026-03-03T16:56:52.462ZTRACtest_metrics (dropshot_external): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86132026-03-03T16:56:52.462ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86142026-03-03T16:56:52.462ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86152026-03-03T16:56:52.462ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86162026-03-03T16:56:52.463ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86172026-03-03T16:56:52.465ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86182026-03-03T16:56:52.465ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86192026-03-03T16:56:52.465ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86202026-03-03T16:56:52.465ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86212026-03-03T16:56:52.467ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86222026-03-03T16:56:52.467ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86232026-03-03T16:56:52.467ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86242026-03-03T16:56:52.467ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86252026-03-03T16:56:52.469ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86262026-03-03T16:56:52.473ZDEBGtest_metrics (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86272026-03-03T16:56:52.473ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86282026-03-03T16:56:52.473ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86292026-03-03T16:56:52.474ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
86302026-03-03T16:56:52.477ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet
86312026-03-03T16:56:52.477ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86322026-03-03T16:56:52.477ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
86332026-03-03T16:56:52.477ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
86342026-03-03T16:56:52.478ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
86352026-03-03T16:56:52.479ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
86362026-03-03T16:56:52.481ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
86372026-03-03T16:56:52.481ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
86382026-03-03T16:56:52.481ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
86392026-03-03T16:56:52.481ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
86402026-03-03T16:56:52.487ZINFOtest_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
86412026-03-03T16:56:52.487ZINFOtest_metrics (SagaExecutor): preparing saga saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create
86422026-03-03T16:56:52.487ZINFOtest_metrics (SEC): saga create dag = {"end_node":12,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[11,0,null],[10,12,null]],"node_holes":[],"nodes":[{"Constant":{"name":"instance_id","value":"b95343ed-bbbf-4a5f-a176-4dea01521dba"}},{"Action":{"action_name":"instance_create.create_instance_record","label":"CreateInstanceRecord","name":"instance_record"}},{"Action":{"action_name":"instance_create.associate_ssh_keys","label":"AssociateSshKeys","name":"output"}},{"Constant":{"name":"network_interface_params0","value":{"instance_id":"b95343ed-bbbf-4a5f-a176-4dea01521dba","instance_name":"i-1","interface_id":"c6b76377-b80f-4757-ac27-e79841018bf2","nic_spec":{"Default":"Ipv4"},"project_id":"41c1c314-b812-4fb3-ab31-28abfa63ce10","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},{"SubsagaStart":{"params_node_name":"network_interface_params0","saga_name":"instance-create-nic0"}},{"Action":{"action_name":"instance_create.create_network_interface","label":"CreateNetworkInterface0","name":"output"}},{"SubsagaEnd":{"name":"network_interface0"}},{"Action":{"action_name":"common.uuid_generate","label":"CreateSnatIpv4Id","name":"snat_ipv4_id"}},{"Action":{"action_name":"instance_create.create_snat_ipv4","label":"CreateSnatIpv4","name":"snat_ipv4"}},{"Action":{"action_name":"instance_create.set_boot_disk","label":"SetBootDisk","name":"set_boot_disk"}},{"Action":{"action_name":"instance_create.move_to_stopped","label":"MoveToStopped","name":"stopped_instance"}},{"Start":{"params":{"boundary_switches":[],"create_params":{"anti_affinity_groups":[],"auto_restart_policy":null,"boot_disk":null,"cpu_platform":null,"description":"instance \\"i-1\\"","disks":[],"external_ips":[],"hostname":"the-host","memory":1073741824,"multicast_groups":[],"name":"i-1","ncpus":4,"network_interfaces":{"type":"default_ipv4"},"ssh_public_keys":[],"start":true,"user_data":"I2Nsb3VkLWNvbmZpZwpzeXN0ZW1faW5mbzoKICBkZWZhdWx0X3VzZXI6CiAgICBuYW1lOiBveGlkZQ=="},"project_id":"41c1c314-b812-4fb3-ab31-28abfa63ce10","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"instance-create","start_node":11} saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
86432026-03-03T16:56:52.487ZINFOtest_metrics (SecStore): creating saga saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create
86442026-03-03T16:56:52.489ZINFOtest_metrics (SagaExecutor): starting saga saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create
86452026-03-03T16:56:52.489ZINFOtest_metrics (SEC): saga start saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
86462026-03-03T16:56:52.489ZDEBGtest_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
86472026-03-03T16:56:52.489ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
86482026-03-03T16:56:52.498ZDEBGtest_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
86492026-03-03T16:56:52.498ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
86502026-03-03T16:56:52.498ZDEBGtest_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
86512026-03-03T16:56:52.498ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
86522026-03-03T16:56:52.498ZDEBGtest_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
86532026-03-03T16:56:52.498ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("b95343ed-bbbf-4a5f-a176-4dea01521dba")) node_id = 0 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
86542026-03-03T16:56:52.499ZDEBGtest_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
86552026-03-03T16:56:52.499ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
86562026-03-03T16:56:52.501ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86572026-03-03T16:56:52.501ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86582026-03-03T16:56:52.501ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86592026-03-03T16:56:52.503ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86602026-03-03T16:56:52.503ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86612026-03-03T16:56:52.503ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86622026-03-03T16:56:52.504ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86632026-03-03T16:56:52.504ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86642026-03-03T16:56:52.504ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86652026-03-03T16:56:52.504ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86662026-03-03T16:56:52.504ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86672026-03-03T16:56:52.505ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86682026-03-03T16:56:52.506ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86692026-03-03T16:56:52.506ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86702026-03-03T16:56:52.506ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86712026-03-03T16:56:52.507ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86722026-03-03T16:56:52.508ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86732026-03-03T16:56:52.508ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86742026-03-03T16:56:52.509ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86752026-03-03T16:56:52.509ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86762026-03-03T16:56:52.519ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86772026-03-03T16:56:52.523ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86782026-03-03T16:56:52.523ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86792026-03-03T16:56:52.523ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86802026-03-03T16:56:52.524ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86812026-03-03T16:56:52.524ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86822026-03-03T16:56:52.524ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86832026-03-03T16:56:52.528ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86842026-03-03T16:56:52.528ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86852026-03-03T16:56:52.528ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86862026-03-03T16:56:52.528ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86872026-03-03T16:56:52.530ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86882026-03-03T16:56:52.530ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86892026-03-03T16:56:52.530ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86902026-03-03T16:56:52.530ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86912026-03-03T16:56:52.532ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86922026-03-03T16:56:52.536ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86932026-03-03T16:56:52.536ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86942026-03-03T16:56:52.536ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86952026-03-03T16:56:52.537ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
86962026-03-03T16:56:52.546ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
86972026-03-03T16:56:52.546ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86982026-03-03T16:56:52.546ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86992026-03-03T16:56:52.577ZINFOtest_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
87002026-03-03T16:56:52.577ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87012026-03-03T16:56:52.578ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = a66f16bd-6651-4468-ab3c-206f66382d48 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87022026-03-03T16:56:52.578ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = a66f16bd-6651-4468-ab3c-206f66382d48 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
87032026-03-03T16:56:52.578ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = a66f16bd-6651-4468-ab3c-206f66382d48 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
87042026-03-03T16:56:52.578ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = a66f16bd-6651-4468-ab3c-206f66382d48 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
87052026-03-03T16:56:52.578ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = a66f16bd-6651-4468-ab3c-206f66382d48 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
87062026-03-03T16:56:52.585ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
87072026-03-03T16:56:52.585ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
87082026-03-03T16:56:52.585ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
87092026-03-03T16:56:52.590ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
87102026-03-03T16:56:52.590ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
87112026-03-03T16:56:52.590ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
87122026-03-03T16:56:52.606ZINFOtest_metrics (dropshot_internal): request completed latency_us = 28620 local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = a66f16bd-6651-4468-ab3c-206f66382d48 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
87132026-03-03T16:56:52.607ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "a66f16bd-6651-4468-ab3c-206f66382d48", "content-length": "405", "date": "Tue, 03 Mar 2026 16:56:52 GMT"} })
87142026-03-03T16:56:52.607ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87152026-03-03T16:56:52.607ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 39dc8c86-01a9-4f8d-a16e-b59e97f20839 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87162026-03-03T16:56:52.607ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 39dc8c86-01a9-4f8d-a16e-b59e97f20839 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
87172026-03-03T16:56:52.608ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 39dc8c86-01a9-4f8d-a16e-b59e97f20839 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
87182026-03-03T16:56:52.608ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 39dc8c86-01a9-4f8d-a16e-b59e97f20839 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
87192026-03-03T16:56:52.608ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 39dc8c86-01a9-4f8d-a16e-b59e97f20839 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
87202026-03-03T16:56:52.612ZINFOtest_metrics (dropshot_internal): request completed latency_us = 4536 local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 39dc8c86-01a9-4f8d-a16e-b59e97f20839 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
87212026-03-03T16:56:52.612ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "39dc8c86-01a9-4f8d-a16e-b59e97f20839", "content-length": "29", "date": "Tue, 03 Mar 2026 16:56:52 GMT"} })
87222026-03-03T16:56:52.612ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
87232026-03-03T16:56:52.612ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
87242026-03-03T16:56:52.612ZINFOtest_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
87252026-03-03T16:56:52.632ZDEBGtest_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
87262026-03-03T16:56:52.632ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "name": String("i-1"), "time_created": String("2026-03-03T16:56:52.501063Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:52.501063Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(1), "migration_id": Null, "nexus_state": String("Creating"), "propolis_id": Null, "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T16:56:52.501063Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}) node_id = 1 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
87272026-03-03T16:56:52.634ZDEBGtest_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
87282026-03-03T16:56:52.634ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
87292026-03-03T16:56:52.636ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87302026-03-03T16:56:52.636ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87312026-03-03T16:56:52.637ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87322026-03-03T16:56:52.638ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87332026-03-03T16:56:52.638ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87342026-03-03T16:56:52.639ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87352026-03-03T16:56:52.640ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87362026-03-03T16:56:52.640ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87372026-03-03T16:56:52.640ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87382026-03-03T16:56:52.640ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87392026-03-03T16:56:52.641ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87402026-03-03T16:56:52.645ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87412026-03-03T16:56:52.645ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87422026-03-03T16:56:52.645ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87432026-03-03T16:56:52.646ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87442026-03-03T16:56:52.648ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
87452026-03-03T16:56:52.648ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87462026-03-03T16:56:52.650ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87472026-03-03T16:56:52.650ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87482026-03-03T16:56:52.650ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87492026-03-03T16:56:52.650ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87502026-03-03T16:56:52.650ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87512026-03-03T16:56:52.650ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87522026-03-03T16:56:52.653ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87532026-03-03T16:56:52.653ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87542026-03-03T16:56:52.653ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87552026-03-03T16:56:52.653ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87562026-03-03T16:56:52.655ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87572026-03-03T16:56:52.657ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87582026-03-03T16:56:52.657ZDEBGtest_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
87592026-03-03T16:56:52.657ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
87602026-03-03T16:56:52.659ZDEBGtest_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
87612026-03-03T16:56:52.659ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
87622026-03-03T16:56:52.660ZDEBGtest_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
87632026-03-03T16:56:52.660ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "instance_name": String("i-1"), "interface_id": String("c6b76377-b80f-4757-ac27-e79841018bf2"), "nic_spec": Object {"Default": String("Ipv4")}, "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}}) node_id = 3 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
87642026-03-03T16:56:52.661ZDEBGtest_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
87652026-03-03T16:56:52.661ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
87662026-03-03T16:56:52.663ZDEBGtest_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
87672026-03-03T16:56:52.663ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
87682026-03-03T16:56:52.664ZDEBGtest_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
87692026-03-03T16:56:52.664ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
87702026-03-03T16:56:52.665ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87712026-03-03T16:56:52.665ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87722026-03-03T16:56:52.666ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87732026-03-03T16:56:52.668ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87742026-03-03T16:56:52.668ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87752026-03-03T16:56:52.668ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87762026-03-03T16:56:52.669ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87772026-03-03T16:56:52.669ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87782026-03-03T16:56:52.670ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87792026-03-03T16:56:52.671ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87802026-03-03T16:56:52.671ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87812026-03-03T16:56:52.671ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87822026-03-03T16:56:52.671ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87832026-03-03T16:56:52.671ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87842026-03-03T16:56:52.673ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87852026-03-03T16:56:52.673ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87862026-03-03T16:56:52.673ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87872026-03-03T16:56:52.673ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87882026-03-03T16:56:52.677ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87892026-03-03T16:56:52.678ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87902026-03-03T16:56:52.678ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87912026-03-03T16:56:52.678ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87922026-03-03T16:56:52.682ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87932026-03-03T16:56:52.689ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87942026-03-03T16:56:52.689ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87952026-03-03T16:56:52.689ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87962026-03-03T16:56:52.689ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87972026-03-03T16:56:52.693ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87982026-03-03T16:56:52.693ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
87992026-03-03T16:56:52.693ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88002026-03-03T16:56:52.693ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88012026-03-03T16:56:52.693ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88022026-03-03T16:56:52.693ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88032026-03-03T16:56:52.694ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88042026-03-03T16:56:52.694ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88052026-03-03T16:56:52.694ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88062026-03-03T16:56:52.700ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") }, key: 453a352b-10aa-4873-adc2-4d11e650f92f, lookup_type: ByName("default") } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88072026-03-03T16:56:52.700ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88082026-03-03T16:56:52.700ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88092026-03-03T16:56:52.700ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88102026-03-03T16:56:52.701ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88112026-03-03T16:56:52.703ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88122026-03-03T16:56:52.703ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88132026-03-03T16:56:52.703ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88142026-03-03T16:56:52.703ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88152026-03-03T16:56:52.705ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88162026-03-03T16:56:52.705ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88172026-03-03T16:56:52.705ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88182026-03-03T16:56:52.706ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88192026-03-03T16:56:52.707ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88202026-03-03T16:56:52.713ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") }, key: 453a352b-10aa-4873-adc2-4d11e650f92f, lookup_type: ByName("default") } result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88212026-03-03T16:56:52.713ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88222026-03-03T16:56:52.713ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88232026-03-03T16:56:52.713ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88242026-03-03T16:56:52.713ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88252026-03-03T16:56:52.714ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88262026-03-03T16:56:52.715ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88272026-03-03T16:56:52.719ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88282026-03-03T16:56:52.719ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88292026-03-03T16:56:52.719ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88302026-03-03T16:56:52.719ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88312026-03-03T16:56:52.719ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88322026-03-03T16:56:52.719ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88332026-03-03T16:56:52.719ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88342026-03-03T16:56:52.719ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88352026-03-03T16:56:52.724ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88362026-03-03T16:56:52.724ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") }, key: 453a352b-10aa-4873-adc2-4d11e650f92f, lookup_type: ByName("default") } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88372026-03-03T16:56:52.724ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88382026-03-03T16:56:52.724ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88392026-03-03T16:56:52.724ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88402026-03-03T16:56:52.725ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88412026-03-03T16:56:52.726ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88422026-03-03T16:56:52.726ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88432026-03-03T16:56:52.726ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88442026-03-03T16:56:52.727ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88452026-03-03T16:56:52.728ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88462026-03-03T16:56:52.728ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88472026-03-03T16:56:52.728ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88482026-03-03T16:56:52.729ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88492026-03-03T16:56:52.730ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88502026-03-03T16:56:52.736ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") }, key: 453a352b-10aa-4873-adc2-4d11e650f92f, lookup_type: ByName("default") } result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88512026-03-03T16:56:52.737ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88522026-03-03T16:56:52.737ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88532026-03-03T16:56:52.737ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88542026-03-03T16:56:52.785ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88552026-03-03T16:56:52.785ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88562026-03-03T16:56:52.785ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88572026-03-03T16:56:52.788ZDEBGtest_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
88582026-03-03T16:56:52.788ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88592026-03-03T16:56:52.789ZDEBGtest_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
88602026-03-03T16:56:52.789ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88612026-03-03T16:56:52.791ZDEBGtest_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
88622026-03-03T16:56:52.791ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88632026-03-03T16:56:52.793ZDEBGtest_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
88642026-03-03T16:56:52.793ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88652026-03-03T16:56:52.797ZDEBGtest_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
88662026-03-03T16:56:52.797ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("53905ede-471d-45f6-89f8-6138580fa0e1")) node_id = 7 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88672026-03-03T16:56:52.801ZDEBGtest_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
88682026-03-03T16:56:52.801ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88692026-03-03T16:56:52.803ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88702026-03-03T16:56:52.803ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88712026-03-03T16:56:52.810ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88722026-03-03T16:56:52.810ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88732026-03-03T16:56:52.810ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88742026-03-03T16:56:52.811ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
88752026-03-03T16:56:52.901ZDEBGtest_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
88762026-03-03T16:56:52.901ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88772026-03-03T16:56:52.903ZDEBGtest_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
88782026-03-03T16:56:52.904ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88792026-03-03T16:56:52.913ZDEBGtest_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
88802026-03-03T16:56:52.913ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88812026-03-03T16:56:52.915ZDEBGtest_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
88822026-03-03T16:56:52.915ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88832026-03-03T16:56:52.920ZDEBGtest_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
88842026-03-03T16:56:52.920ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88852026-03-03T16:56:52.934ZDEBGtest_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
88862026-03-03T16:56:52.934ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88872026-03-03T16:56:52.943ZDEBGtest_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
88882026-03-03T16:56:52.943ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88892026-03-03T16:56:52.946ZINFOtest_metrics (SEC): update for saga cached state new_state = Done saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da sec_id = 913233fe-92a8-4635-9572-183f495429c4
88902026-03-03T16:56:52.946ZINFOtest_metrics (SecStore): updating state new_state = done saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88912026-03-03T16:56:52.976ZINFOtest_metrics (SEC): saga finished result = success saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
88922026-03-03T16:56:52.976ZINFOtest_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da
88932026-03-03T16:56:52.976ZINFOtest_metrics (SagaExecutor): saga finished saga_id = 7252a611-d7ed-4dc6-8403-cea98839b2da saga_name = instance-create saga_result = SagaResult { saga_id: 7252a611-d7ed-4dc6-8403-cea98839b2da, saga_log: SagaLog { saga_id: 7252a611-d7ed-4dc6-8403-cea98839b2da, unwinding: false, events: [N011 started, N011 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N012 started, N012 succeeded], node_status: {0: Succeeded(String("b95343ed-bbbf-4a5f-a176-4dea01521dba")), 1: Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "name": String("i-1"), "time_created": String("2026-03-03T16:56:52.501063Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:52.501063Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(1), "migration_id": Null, "nexus_state": String("Creating"), "propolis_id": Null, "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T16:56:52.501063Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}), 2: Succeeded(Null), 3: Succeeded(Object {"instance_id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "instance_name": String("i-1"), "interface_id": String("c6b76377-b80f-4757-ac27-e79841018bf2"), "nic_spec": Object {"Default": String("Ipv4")}, "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}}), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(String("53905ede-471d-45f6-89f8-6138580fa0e1")), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"instance_id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "instance_record": Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "name": String("i-1"), "time_created": String("2026-03-03T16:56:52.501063Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:52.501063Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(1), "migration_id": Null, "nexus_state": String("Creating"), "propolis_id": Null, "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T16:56:52.501063Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}, "network_interface0": Null, "network_interface_params0": Object {"instance_id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "instance_name": String("i-1"), "interface_id": String("c6b76377-b80f-4757-ac27-e79841018bf2"), "nic_spec": Object {"Default": String("Ipv4")}, "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}}, "output": Null, "set_boot_disk": Null, "snat_ipv4": Null, "snat_ipv4_id": String("53905ede-471d-45f6-89f8-6138580fa0e1"), "stopped_instance": Null} }) }
88942026-03-03T16:56:52.977ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
88952026-03-03T16:56:52.977ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
88962026-03-03T16:56:52.977ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
88972026-03-03T16:56:52.980ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
88982026-03-03T16:56:52.980ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
88992026-03-03T16:56:52.980ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89002026-03-03T16:56:52.993ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89012026-03-03T16:56:52.993ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89022026-03-03T16:56:52.994ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89032026-03-03T16:56:52.995ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89042026-03-03T16:56:52.995ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89052026-03-03T16:56:52.995ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89062026-03-03T16:56:52.995ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89072026-03-03T16:56:52.996ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89082026-03-03T16:56:53.005ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89092026-03-03T16:56:53.005ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89102026-03-03T16:56:53.005ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89112026-03-03T16:56:53.005ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89122026-03-03T16:56:53.005ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89132026-03-03T16:56:53.005ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89142026-03-03T16:56:53.005ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89152026-03-03T16:56:53.005ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89162026-03-03T16:56:53.006ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89172026-03-03T16:56:53.011ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89182026-03-03T16:56:53.012ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89192026-03-03T16:56:53.012ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89202026-03-03T16:56:53.012ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89212026-03-03T16:56:53.012ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89222026-03-03T16:56:53.012ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89232026-03-03T16:56:53.012ZDEBGtest_metrics (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 3 reason = Timeout
89242026-03-03T16:56:53.012ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig
89252026-03-03T16:56:53.013ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = reconfigurator_config_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89262026-03-03T16:56:53.013ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
89272026-03-03T16:56:53.013ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
89282026-03-03T16:56:53.016ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
89292026-03-03T16:56:53.020ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89302026-03-03T16:56:53.020ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89312026-03-03T16:56:53.020ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89322026-03-03T16:56:53.021ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89332026-03-03T16:56:53.022ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89342026-03-03T16:56:53.029ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
89352026-03-03T16:56:53.029ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
89362026-03-03T16:56:53.029ZDEBGtest_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
89372026-03-03T16:56:53.030ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
89382026-03-03T16:56:53.034ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89392026-03-03T16:56:53.036ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89402026-03-03T16:56:53.036ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89412026-03-03T16:56:53.036ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89422026-03-03T16:56:53.036ZDEBGtest_metrics (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: false, planner_config: PlannerConfig { add_zones_with_mupdate_override: false }, tuf_repo_pruner_enabled: true }, time_modified: 2026-03-03T16:56:42.943994Z })
89432026-03-03T16:56:53.036ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 23.779118ms iteration = 3 status = {"config_updated":false}
89442026-03-03T16:56:53.038ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89452026-03-03T16:56:53.061ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89462026-03-03T16:56:53.061ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89472026-03-03T16:56:53.061ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89482026-03-03T16:56:53.062ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89492026-03-03T16:56:53.067ZTRACtest_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89502026-03-03T16:56:53.067ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89512026-03-03T16:56:53.067ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89522026-03-03T16:56:53.067ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89532026-03-03T16:56:53.067ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89542026-03-03T16:56:53.071ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89552026-03-03T16:56:53.071ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89562026-03-03T16:56:53.071ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89572026-03-03T16:56:53.071ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89582026-03-03T16:56:53.074ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89592026-03-03T16:56:53.074ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89602026-03-03T16:56:53.074ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89612026-03-03T16:56:53.074ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89622026-03-03T16:56:53.090ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89632026-03-03T16:56:53.096ZDEBGtest_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89642026-03-03T16:56:53.123ZINFOtest_metrics (dropshot_external): set intended instance state authenticated = true changed = false instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba intended_state = running local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
89652026-03-03T16:56:53.123ZINFOtest_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
89662026-03-03T16:56:53.123ZINFOtest_metrics (SagaExecutor): preparing saga saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start
89672026-03-03T16:56:53.123ZINFOtest_metrics (SEC): saga create dag = {"end_node":25,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[5,7,null],[5,8,null],[5,9,null],[5,10,null],[5,11,null],[5,12,null],[5,13,null],[5,14,null],[5,15,null],[5,16,null],[5,17,null],[6,18,null],[7,18,null],[8,18,null],[9,18,null],[10,18,null],[11,18,null],[12,18,null],[13,18,null],[14,18,null],[15,18,null],[16,18,null],[17,18,null],[18,19,null],[19,20,null],[20,21,null],[21,22,null],[22,23,null],[24,0,null],[23,25,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_start.generate_propolis_id","label":"GeneratePropolisId","name":"propolis_id"}},{"Action":{"action_name":"instance_start.alloc_server","label":"AllocServer","name":"sled_id"}},{"Action":{"action_name":"instance_start.alloc_propolis_ip","label":"AllocPropolisIp","name":"propolis_ip"}},{"Action":{"action_name":"instance_start.create_vmm_record","label":"CreateVmmRecord","name":"vmm_record"}},{"Action":{"action_name":"instance_start.mark_as_starting","label":"MarkAsStarting","name":"started_record"}},{"Action":{"action_name":"instance_start.list_local_storage","label":"ListLocalStorage","name":"local_storage_records"}},{"Action":{"action_name":"instance_start.ensure_local_storage_0","label":"EnsureLocalStorage_0","name":"ensure_local_storage_0"}},{"Action":{"action_name":"instance_start.ensure_local_storage_1","label":"EnsureLocalStorage_1","name":"ensure_local_storage_1"}},{"Action":{"action_name":"instance_start.ensure_local_storage_2","label":"EnsureLocalStorage_2","name":"ensure_local_storage_2"}},{"Action":{"action_name":"instance_start.ensure_local_storage_3","label":"EnsureLocalStorage_3","name":"ensure_local_storage_3"}},{"Action":{"action_name":"instance_start.ensure_local_storage_4","label":"EnsureLocalStorage_4","name":"ensure_local_storage_4"}},{"Action":{"action_name":"instance_start.ensure_local_storage_5","label":"EnsureLocalStorage_5","name":"ensure_local_storage_5"}},{"Action":{"action_name":"instance_start.ensure_local_storage_6","label":"EnsureLocalStorage_6","name":"ensure_local_storage_6"}},{"Action":{"action_name":"instance_start.ensure_local_storage_7","label":"EnsureLocalStorage_7","name":"ensure_local_storage_7"}},{"Action":{"action_name":"instance_start.ensure_local_storage_8","label":"EnsureLocalStorage_8","name":"ensure_local_storage_8"}},{"Action":{"action_name":"instance_start.ensure_local_storage_9","label":"EnsureLocalStorage_9","name":"ensure_local_storage_9"}},{"Action":{"action_name":"instance_start.ensure_local_storage_10","label":"EnsureLocalStorage_10","name":"ensure_local_storage_10"}},{"Action":{"action_name":"instance_start.ensure_local_storage_11","label":"EnsureLocalStorage_11","name":"ensure_local_storage_11"}},{"Action":{"action_name":"instance_start.dpd_ensure","label":"DpdEnsure","name":"dpd_ensure"}},{"Action":{"action_name":"instance_start.v2p_ensure","label":"V2PEnsure","name":"v2p_ensure"}},{"Action":{"action_name":"instance_start.ensure_registered","label":"EnsureRegistered","name":"ensure_registered"}},{"Action":{"action_name":"instance_start.update_multicast_sled_id","label":"UpdateMulticastSledId","name":"multicast_sled_id"}},{"Action":{"action_name":"instance_start.add_virtual_resources","label":"AddVirtualResources","name":"virtual_resources"}},{"Action":{"action_name":"instance_start.ensure_running","label":"EnsureRunning","name":"ensure_running"}},{"Start":{"params":{"db_instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":null,"cpu_platform":null,"hostname":"the-host","identity":{"description":"instance \\"i-1\\"","id":"b95343ed-bbbf-4a5f-a176-4dea01521dba","name":"i-1","time_created":"2026-03-03T16:56:52.501063Z","time_deleted":null,"time_modified":"2026-03-03T16:56:52.501063Z"},"intended_state":"Running","memory":1073741824,"ncpus":4,"project_id":"41c1c314-b812-4fb3-ab31-28abfa63ce10","runtime_state":{"dst_propolis_id":null,"gen":2,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2026-03-03T16:56:52.501063Z"},"updater_gen":1,"updater_id":null,"user_data":[35,99,108,111,117,100,45,99,111,110,102,105,103,10,115,121,115,116,101,109,95,105,110,102,111,58,10,32,32,100,101,102,97,117,108,116,95,117,115,101,114,58,10,32,32,32,32,110,97,109,101,58,32,111,120,105,100,101]},"reason":"AutoStart","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"instance-start","start_node":24} saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start sec_id = 913233fe-92a8-4635-9572-183f495429c4
89682026-03-03T16:56:53.123ZINFOtest_metrics (SecStore): creating saga saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start
89692026-03-03T16:56:53.126ZINFOtest_metrics (SagaExecutor): starting saga saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start
89702026-03-03T16:56:53.126ZINFOtest_metrics (SEC): saga start saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start sec_id = 913233fe-92a8-4635-9572-183f495429c4
89712026-03-03T16:56:53.126ZDEBGtest_metrics (SEC): saga log event new_state = N024 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
89722026-03-03T16:56:53.126ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 24 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
89732026-03-03T16:56:53.128ZDEBGtest_metrics (SEC): saga log event new_state = N024 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
89742026-03-03T16:56:53.128ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 24 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
89752026-03-03T16:56:53.129ZDEBGtest_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
89762026-03-03T16:56:53.129ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
89772026-03-03T16:56:53.131ZDEBGtest_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
89782026-03-03T16:56:53.131ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("1620a67d-f446-4d32-8084-98dcaf9d53b1")) node_id = 0 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
89792026-03-03T16:56:53.132ZDEBGtest_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
89802026-03-03T16:56:53.132ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
89812026-03-03T16:56:53.134ZINFOtest_metrics (InstanceAllocator): sled reservation starting instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba propolis_id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 query = sled_reservation
89822026-03-03T16:56:53.134ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
89832026-03-03T16:56:53.134ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
89842026-03-03T16:56:53.134ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
89852026-03-03T16:56:53.140ZINFOtest_metrics (InstanceAllocator): no attached local storage disks instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba propolis_id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 query = sled_reservation
89862026-03-03T16:56:53.148ZINFOtest_metrics (InstanceAllocator): sled targets: {b6d65341-167c-41df-9b5c-41cded99c229 (sled)} instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba propolis_id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 query = sled_reservation
89872026-03-03T16:56:53.148ZINFOtest_metrics (InstanceAllocator): local_storage_allocation_required: false instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba propolis_id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 query = sled_reservation
89882026-03-03T16:56:53.148ZINFOtest_metrics (InstanceAllocator): trying sled target b6d65341-167c-41df-9b5c-41cded99c229 instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba propolis_id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 query = sled_reservation
89892026-03-03T16:56:53.148ZINFOtest_metrics (InstanceAllocator): attempting to insert sled resource record instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba local_storage_required = false propolis_id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 query = sled_reservation
89902026-03-03T16:56:53.153ZINFOtest_metrics (InstanceAllocator): reservation succeeded! instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba propolis_id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 query = sled_reservation
89912026-03-03T16:56:53.153ZDEBGtest_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
89922026-03-03T16:56:53.153ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("b6d65341-167c-41df-9b5c-41cded99c229")) node_id = 1 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
89932026-03-03T16:56:53.155ZDEBGtest_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
89942026-03-03T16:56:53.156ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
89952026-03-03T16:56:53.157ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = AllocPropolisIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
89962026-03-03T16:56:53.157ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = AllocPropolisIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
89972026-03-03T16:56:53.158ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = AllocPropolisIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
89982026-03-03T16:56:53.178ZDEBGtest_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
89992026-03-03T16:56:53.178ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("::1:0")) node_id = 2 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
90002026-03-03T16:56:53.181ZDEBGtest_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
90012026-03-03T16:56:53.181ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
90022026-03-03T16:56:53.183ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
90032026-03-03T16:56:53.183ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
90042026-03-03T16:56:53.184ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
90052026-03-03T16:56:53.189ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
90062026-03-03T16:56:53.190ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
90072026-03-03T16:56:53.190ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
90082026-03-03T16:56:53.190ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
90092026-03-03T16:56:53.192ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
90102026-03-03T16:56:53.195ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
90112026-03-03T16:56:53.199ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
90122026-03-03T16:56:53.199ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = CreateVmmRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90132026-03-03T16:56:53.199ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = CreateVmmRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90142026-03-03T16:56:53.205ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = CreateVmmRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90152026-03-03T16:56:53.288ZDEBGtest_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
90162026-03-03T16:56:53.288ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("1620a67d-f446-4d32-8084-98dcaf9d53b1"), "instance_id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(1), "state": String("Creating"), "time_state_updated": String("2026-03-03T16:56:53.199577Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T16:56:53.199577Z"), "time_deleted": Null}) node_id = 3 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
90172026-03-03T16:56:53.297ZDEBGtest_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
90182026-03-03T16:56:53.297ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
90192026-03-03T16:56:53.308ZINFOtest_metrics (SagaExecutor): moving instance to Starting state via saga instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba propolis_id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start start_reason = AutoStart
90202026-03-03T16:56:53.308ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90212026-03-03T16:56:53.308ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90222026-03-03T16:56:53.308ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90232026-03-03T16:56:53.310ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90242026-03-03T16:56:53.312ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90252026-03-03T16:56:53.312ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90262026-03-03T16:56:53.312ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90272026-03-03T16:56:53.312ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90282026-03-03T16:56:53.313ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90292026-03-03T16:56:53.314ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90302026-03-03T16:56:53.314ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90312026-03-03T16:56:53.314ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90322026-03-03T16:56:53.319ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90332026-03-03T16:56:53.319ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90342026-03-03T16:56:53.319ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90352026-03-03T16:56:53.319ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90362026-03-03T16:56:53.319ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90372026-03-03T16:56:53.319ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90382026-03-03T16:56:53.319ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90392026-03-03T16:56:53.319ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90402026-03-03T16:56:53.319ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90412026-03-03T16:56:53.319ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90422026-03-03T16:56:53.321ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90432026-03-03T16:56:53.325ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90442026-03-03T16:56:53.325ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90452026-03-03T16:56:53.326ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90462026-03-03T16:56:53.326ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90472026-03-03T16:56:53.326ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90482026-03-03T16:56:53.326ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90492026-03-03T16:56:53.339ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90502026-03-03T16:56:53.339ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90512026-03-03T16:56:53.339ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90522026-03-03T16:56:53.340ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90532026-03-03T16:56:53.341ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90542026-03-03T16:56:53.342ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90552026-03-03T16:56:53.342ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90562026-03-03T16:56:53.342ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90572026-03-03T16:56:53.345ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90582026-03-03T16:56:53.350ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90592026-03-03T16:56:53.350ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90602026-03-03T16:56:53.350ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90612026-03-03T16:56:53.351ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90622026-03-03T16:56:53.358ZDEBGtest_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
90632026-03-03T16:56:53.358ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "name": String("i-1"), "time_created": String("2026-03-03T16:56:52.501063Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:52.501063Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(3), "migration_id": Null, "nexus_state": String("Vmm"), "propolis_id": String("1620a67d-f446-4d32-8084-98dcaf9d53b1"), "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T16:56:52.501063Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}) node_id = 4 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
90642026-03-03T16:56:53.360ZDEBGtest_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
90652026-03-03T16:56:53.362ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
90662026-03-03T16:56:53.362ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90672026-03-03T16:56:53.362ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90682026-03-03T16:56:53.363ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90692026-03-03T16:56:53.364ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90702026-03-03T16:56:53.364ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90712026-03-03T16:56:53.365ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90722026-03-03T16:56:53.367ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90732026-03-03T16:56:53.367ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90742026-03-03T16:56:53.367ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90752026-03-03T16:56:53.368ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90762026-03-03T16:56:53.369ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90772026-03-03T16:56:53.369ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90782026-03-03T16:56:53.369ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90792026-03-03T16:56:53.369ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90802026-03-03T16:56:53.370ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90812026-03-03T16:56:53.370ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90822026-03-03T16:56:53.370ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90832026-03-03T16:56:53.370ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90842026-03-03T16:56:53.372ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90852026-03-03T16:56:53.372ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90862026-03-03T16:56:53.372ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90872026-03-03T16:56:53.373ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90882026-03-03T16:56:53.376ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90892026-03-03T16:56:53.382ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90902026-03-03T16:56:53.382ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90912026-03-03T16:56:53.382ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90922026-03-03T16:56:53.382ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90932026-03-03T16:56:53.383ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90942026-03-03T16:56:53.383ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90952026-03-03T16:56:53.383ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90962026-03-03T16:56:53.383ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90972026-03-03T16:56:53.383ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90982026-03-03T16:56:53.385ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
90992026-03-03T16:56:53.385ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91002026-03-03T16:56:53.385ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91012026-03-03T16:56:53.386ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91022026-03-03T16:56:53.387ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91032026-03-03T16:56:53.387ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91042026-03-03T16:56:53.388ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91052026-03-03T16:56:53.388ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91062026-03-03T16:56:53.390ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91072026-03-03T16:56:53.409ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91082026-03-03T16:56:53.411ZDEBGtest_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91092026-03-03T16:56:53.411ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 5 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91102026-03-03T16:56:53.413ZDEBGtest_metrics (SEC): saga log event new_state = N017 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91112026-03-03T16:56:53.413ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91122026-03-03T16:56:53.415ZDEBGtest_metrics (SEC): saga log event new_state = N017 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91132026-03-03T16:56:53.415ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91142026-03-03T16:56:53.427ZDEBGtest_metrics (SEC): saga log event new_state = N016 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91152026-03-03T16:56:53.427ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91162026-03-03T16:56:53.431ZDEBGtest_metrics (SEC): saga log event new_state = N016 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91172026-03-03T16:56:53.431ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91182026-03-03T16:56:53.444ZDEBGtest_metrics (SEC): saga log event new_state = N015 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91192026-03-03T16:56:53.444ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91202026-03-03T16:56:53.451ZDEBGtest_metrics (SEC): saga log event new_state = N015 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91212026-03-03T16:56:53.452ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 15 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91222026-03-03T16:56:53.453ZDEBGtest_metrics (SEC): saga log event new_state = N014 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91232026-03-03T16:56:53.453ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91242026-03-03T16:56:53.460ZDEBGtest_metrics (SEC): saga log event new_state = N014 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91252026-03-03T16:56:53.462ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91262026-03-03T16:56:53.462ZDEBGtest_metrics (SEC): saga log event new_state = N013 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91272026-03-03T16:56:53.463ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91282026-03-03T16:56:53.465ZDEBGtest_metrics (SEC): saga log event new_state = N013 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91292026-03-03T16:56:53.465ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91302026-03-03T16:56:53.466ZDEBGtest_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91312026-03-03T16:56:53.468ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91322026-03-03T16:56:53.468ZDEBGtest_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91332026-03-03T16:56:53.468ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91342026-03-03T16:56:53.471ZDEBGtest_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91352026-03-03T16:56:53.472ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91362026-03-03T16:56:53.472ZDEBGtest_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91372026-03-03T16:56:53.472ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91382026-03-03T16:56:53.474ZDEBGtest_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91392026-03-03T16:56:53.474ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91402026-03-03T16:56:53.475ZDEBGtest_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91412026-03-03T16:56:53.476ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91422026-03-03T16:56:53.477ZDEBGtest_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91432026-03-03T16:56:53.477ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91442026-03-03T16:56:53.478ZDEBGtest_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91452026-03-03T16:56:53.480ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91462026-03-03T16:56:53.480ZDEBGtest_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91472026-03-03T16:56:53.480ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91482026-03-03T16:56:53.481ZDEBGtest_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91492026-03-03T16:56:53.481ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91502026-03-03T16:56:53.483ZDEBGtest_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91512026-03-03T16:56:53.484ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91522026-03-03T16:56:53.485ZDEBGtest_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91532026-03-03T16:56:53.485ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91542026-03-03T16:56:53.487ZDEBGtest_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91552026-03-03T16:56:53.487ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91562026-03-03T16:56:53.489ZDEBGtest_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
91572026-03-03T16:56:53.491ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91582026-03-03T16:56:53.491ZDEBGtest_metrics (SEC): saga log event new_state = N018 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
91592026-03-03T16:56:53.491ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 18 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
91602026-03-03T16:56:53.492ZINFOtest_metrics (SagaExecutor): start saga: ensuring instance dpd configuration instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start start_reason = AutoStart
91612026-03-03T16:56:53.492ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
91622026-03-03T16:56:53.492ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
91632026-03-03T16:56:53.493ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
91642026-03-03T16:56:53.494ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
91652026-03-03T16:56:53.495ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
91662026-03-03T16:56:53.495ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
91672026-03-03T16:56:53.495ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
91682026-03-03T16:56:53.495ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
91692026-03-03T16:56:53.496ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
91702026-03-03T16:56:53.499ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
91712026-03-03T16:56:53.499ZINFOtest_metrics (nexus): looking up instance's primary network interface instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba
91722026-03-03T16:56:53.499ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91732026-03-03T16:56:53.499ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91742026-03-03T16:56:53.500ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91752026-03-03T16:56:53.502ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91762026-03-03T16:56:53.502ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91772026-03-03T16:56:53.502ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91782026-03-03T16:56:53.503ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
91792026-03-03T16:56:53.503ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
91802026-03-03T16:56:53.503ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
91812026-03-03T16:56:53.505ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
91822026-03-03T16:56:53.506ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91832026-03-03T16:56:53.506ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91842026-03-03T16:56:53.506ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91852026-03-03T16:56:53.507ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91862026-03-03T16:56:53.507ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91872026-03-03T16:56:53.507ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91882026-03-03T16:56:53.507ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91892026-03-03T16:56:53.507ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91902026-03-03T16:56:53.509ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
91912026-03-03T16:56:53.509ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
91922026-03-03T16:56:53.509ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91932026-03-03T16:56:53.509ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91942026-03-03T16:56:53.509ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91952026-03-03T16:56:53.509ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91962026-03-03T16:56:53.511ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
91972026-03-03T16:56:53.511ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
91982026-03-03T16:56:53.511ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
91992026-03-03T16:56:53.511ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92002026-03-03T16:56:53.511ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92012026-03-03T16:56:53.511ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92022026-03-03T16:56:53.513ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92032026-03-03T16:56:53.518ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92042026-03-03T16:56:53.518ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92052026-03-03T16:56:53.518ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92062026-03-03T16:56:53.518ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92072026-03-03T16:56:53.518ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92082026-03-03T16:56:53.519ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92092026-03-03T16:56:53.523ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92102026-03-03T16:56:53.523ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92112026-03-03T16:56:53.523ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92122026-03-03T16:56:53.523ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92132026-03-03T16:56:53.528ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92142026-03-03T16:56:53.528ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92152026-03-03T16:56:53.528ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92162026-03-03T16:56:53.536ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92172026-03-03T16:56:53.538ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92182026-03-03T16:56:53.544ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92192026-03-03T16:56:53.544ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92202026-03-03T16:56:53.544ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92212026-03-03T16:56:53.544ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92222026-03-03T16:56:53.547ZINFOtest_metrics (nexus): looking up instance's external IPs instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba
92232026-03-03T16:56:53.547ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92242026-03-03T16:56:53.547ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92252026-03-03T16:56:53.548ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92262026-03-03T16:56:53.550ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92272026-03-03T16:56:53.550ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92282026-03-03T16:56:53.551ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92292026-03-03T16:56:53.553ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet
92302026-03-03T16:56:53.554ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
92312026-03-03T16:56:53.554ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
92322026-03-03T16:56:53.554ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
92332026-03-03T16:56:53.554ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
92342026-03-03T16:56:53.555ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
92352026-03-03T16:56:53.557ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
92362026-03-03T16:56:53.558ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
92372026-03-03T16:56:53.558ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
92382026-03-03T16:56:53.558ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
92392026-03-03T16:56:53.559ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
92402026-03-03T16:56:53.559ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: fb bc 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:65190 req_id = d92108a8-bc73-4fc0-99f2-78e9154a081b
92412026-03-03T16:56:53.559ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 64444,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:65190 req_id = d92108a8-bc73-4fc0-99f2-78e9154a081b
92422026-03-03T16:56:53.560ZDEBGtest_metrics (store): query key key = _dendrite._tcp
92432026-03-03T16:56:53.560ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
92442026-03-03T16:56:53.561ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:65190 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = d92108a8-bc73-4fc0-99f2-78e9154a081b
92452026-03-03T16:56:53.561ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1875, tv_nsec: 816854130 } })
92462026-03-03T16:56:53.561ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
92472026-03-03T16:56:53.561ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 29 00 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e )...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:1087 req_id = 9ebf0e79-94b5-4adc-9b2a-1fd33b205dee
92482026-03-03T16:56:53.561ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 10496,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:1087 req_id = 9ebf0e79-94b5-4adc-9b2a-1fd33b205dee
92492026-03-03T16:56:53.561ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
92502026-03-03T16:56:53.561ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:1087 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 9ebf0e79-94b5-4adc-9b2a-1fd33b205dee
92512026-03-03T16:56:53.579ZTRACtest_metrics (DpdClient): client request body = None method = GET uri = http://[::1]:42205/switch/identifiers
92522026-03-03T16:56:53.579ZTRACtest_metrics (DpdClient): client response result = Ok(Response { url: "http://[::1]:42205/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "91f414f7-8ecd-43fc-9d4f-f74d97ddac3b", "content-length": "206", "date": "Tue, 03 Mar 2026 16:56:53 GMT"} })
92532026-03-03T16:56:53.581ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92542026-03-03T16:56:53.581ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92552026-03-03T16:56:53.583ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92562026-03-03T16:56:53.584ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
92572026-03-03T16:56:53.584ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
92582026-03-03T16:56:53.586ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
92592026-03-03T16:56:53.586ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
92602026-03-03T16:56:53.586ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
92612026-03-03T16:56:53.586ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
92622026-03-03T16:56:53.606ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
92632026-03-03T16:56:53.622ZDEBGtest_metrics (nexus): no subnets attached to instance, nothing to notify Dendrite about instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba
92642026-03-03T16:56:53.629ZDEBGtest_metrics (SEC): saga log event new_state = N018 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
92652026-03-03T16:56:53.629ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
92662026-03-03T16:56:53.629ZDEBGtest_metrics (SEC): saga log event new_state = N019 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
92672026-03-03T16:56:53.629ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 19 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
92682026-03-03T16:56:53.629ZDEBGtest_metrics (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Signaled
92692026-03-03T16:56:53.629ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
92702026-03-03T16:56:53.629ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92712026-03-03T16:56:53.629ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
92722026-03-03T16:56:53.629ZDEBGtest_metrics (SEC): saga log event new_state = N019 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
92732026-03-03T16:56:53.629ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
92742026-03-03T16:56:53.629ZDEBGtest_metrics (SEC): saga log event new_state = N020 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
92752026-03-03T16:56:53.629ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 20 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
92762026-03-03T16:56:53.640ZINFOtest_metrics (SagaExecutor): start saga: ensuring instance is registered on sled instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_reason = AutoStart
92772026-03-03T16:56:53.640ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92782026-03-03T16:56:53.640ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92792026-03-03T16:56:53.640ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92802026-03-03T16:56:53.643ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92812026-03-03T16:56:53.643ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92822026-03-03T16:56:53.644ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92832026-03-03T16:56:53.645ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92842026-03-03T16:56:53.647ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92852026-03-03T16:56:53.647ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92862026-03-03T16:56:53.647ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92872026-03-03T16:56:53.647ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92882026-03-03T16:56:53.647ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92892026-03-03T16:56:53.647ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92902026-03-03T16:56:53.648ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92912026-03-03T16:56:53.650ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92922026-03-03T16:56:53.650ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92932026-03-03T16:56:53.650ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92942026-03-03T16:56:53.651ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92952026-03-03T16:56:53.652ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92962026-03-03T16:56:53.652ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92972026-03-03T16:56:53.652ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92982026-03-03T16:56:53.653ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
92992026-03-03T16:56:53.655ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93002026-03-03T16:56:53.660ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93012026-03-03T16:56:53.660ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93022026-03-03T16:56:53.660ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93032026-03-03T16:56:53.660ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93042026-03-03T16:56:53.660ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93052026-03-03T16:56:53.661ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93062026-03-03T16:56:53.663ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93072026-03-03T16:56:53.663ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93082026-03-03T16:56:53.663ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93092026-03-03T16:56:53.663ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93102026-03-03T16:56:53.665ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
93112026-03-03T16:56:53.666ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93122026-03-03T16:56:53.666ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
93132026-03-03T16:56:53.666ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93142026-03-03T16:56:53.666ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93152026-03-03T16:56:53.666ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93162026-03-03T16:56:53.666ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93172026-03-03T16:56:53.668ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93182026-03-03T16:56:53.673ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93192026-03-03T16:56:53.673ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93202026-03-03T16:56:53.673ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93212026-03-03T16:56:53.674ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93222026-03-03T16:56:53.674ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
93232026-03-03T16:56:53.674ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
93242026-03-03T16:56:53.674ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
93252026-03-03T16:56:53.674ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93262026-03-03T16:56:53.675ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
93272026-03-03T16:56:53.675ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93282026-03-03T16:56:53.675ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93292026-03-03T16:56:53.675ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93302026-03-03T16:56:53.675ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93312026-03-03T16:56:53.676ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93322026-03-03T16:56:53.676ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93332026-03-03T16:56:53.679ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93342026-03-03T16:56:53.679ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
93352026-03-03T16:56:53.679ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
93362026-03-03T16:56:53.679ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
93372026-03-03T16:56:53.680ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93382026-03-03T16:56:53.680ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
93392026-03-03T16:56:53.680ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93402026-03-03T16:56:53.680ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93412026-03-03T16:56:53.680ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93422026-03-03T16:56:53.681ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93432026-03-03T16:56:53.684ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93442026-03-03T16:56:53.688ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93452026-03-03T16:56:53.688ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
93462026-03-03T16:56:53.688ZDEBGtest_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93472026-03-03T16:56:53.688ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
93482026-03-03T16:56:53.690ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93492026-03-03T16:56:53.691ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93502026-03-03T16:56:53.691ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93512026-03-03T16:56:53.691ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93522026-03-03T16:56:53.699ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = None method = GET uri = http://[::1]:33115/v2p
93532026-03-03T16:56:53.700ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47684 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
93542026-03-03T16:56:53.700ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = GET remote_addr = [::1]:47684 req_id = 2f3e5295-5399-4ec3-972d-83d4fe9ede2a sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
93552026-03-03T16:56:53.700ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = GET remote_addr = [::1]:47684 req_id = 2f3e5295-5399-4ec3-972d-83d4fe9ede2a sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
93562026-03-03T16:56:53.700ZINFOtest_metrics (dropshot): request completed latency_us = 165 local_addr = [::1]:33115 method = GET remote_addr = [::1]:47684 req_id = 2f3e5295-5399-4ec3-972d-83d4fe9ede2a response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
93572026-03-03T16:56:53.700ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:33115/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f3e5295-5399-4ec3-972d-83d4fe9ede2a", "content-length": "2", "date": "Tue, 03 Mar 2026 16:56:53 GMT"} })
93582026-03-03T16:56:53.700ZINFOtest_metrics (BackgroundTasks): found opte v2p mappings background_task = v2p_manager interfaces = {} sled = SimGimlet00
93592026-03-03T16:56:53.700ZINFOtest_metrics (BackgroundTasks): v2p mappings to delete background_task = v2p_manager mappings = [] sled = SimGimlet00
93602026-03-03T16:56:53.700ZINFOtest_metrics (BackgroundTasks): v2p mappings to add background_task = v2p_manager mappings = [VirtualNetworkInterfaceHost { physical_host_ip: ::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(1795622) }] sled = SimGimlet00
93612026-03-03T16:56:53.701ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = Some(Body) method = PUT uri = http://[::1]:33115/v2p
93622026-03-03T16:56:53.701ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47684 req_id = e1cb02d8-db7c-4d6d-a8a7-d701b84e5354 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
93632026-03-03T16:56:53.701ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47684 req_id = e1cb02d8-db7c-4d6d-a8a7-d701b84e5354 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
93642026-03-03T16:56:53.701ZINFOtest_metrics (dropshot): request completed latency_us = 208 local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47684 req_id = e1cb02d8-db7c-4d6d-a8a7-d701b84e5354 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
93652026-03-03T16:56:53.701ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93662026-03-03T16:56:53.707ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93672026-03-03T16:56:53.707ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:33115/v2p", status: 204, headers: {"x-request-id": "e1cb02d8-db7c-4d6d-a8a7-d701b84e5354", "date": "Tue, 03 Mar 2026 16:56:53 GMT"} })
93682026-03-03T16:56:53.707ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 81.072649ms iteration = 2 status = {}
93692026-03-03T16:56:53.709ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93702026-03-03T16:56:53.709ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93712026-03-03T16:56:53.709ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93722026-03-03T16:56:53.709ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93732026-03-03T16:56:53.709ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93742026-03-03T16:56:53.711ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93752026-03-03T16:56:53.711ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93762026-03-03T16:56:53.711ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93772026-03-03T16:56:53.718ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93782026-03-03T16:56:53.718ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93792026-03-03T16:56:53.718ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93802026-03-03T16:56:53.718ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93812026-03-03T16:56:53.718ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93822026-03-03T16:56:53.720ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93832026-03-03T16:56:53.726ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93842026-03-03T16:56:53.729ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93852026-03-03T16:56:53.729ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93862026-03-03T16:56:53.729ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93872026-03-03T16:56:53.729ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93882026-03-03T16:56:53.730ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93892026-03-03T16:56:53.730ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93902026-03-03T16:56:53.731ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93912026-03-03T16:56:53.731ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93922026-03-03T16:56:53.732ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93932026-03-03T16:56:53.733ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93942026-03-03T16:56:53.734ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93952026-03-03T16:56:53.734ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93962026-03-03T16:56:53.735ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93972026-03-03T16:56:53.735ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93982026-03-03T16:56:53.735ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
93992026-03-03T16:56:53.736ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94002026-03-03T16:56:53.736ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94012026-03-03T16:56:53.737ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94022026-03-03T16:56:53.738ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94032026-03-03T16:56:53.738ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94042026-03-03T16:56:53.738ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94052026-03-03T16:56:53.738ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94062026-03-03T16:56:53.738ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94072026-03-03T16:56:53.739ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94082026-03-03T16:56:53.740ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94092026-03-03T16:56:53.740ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94102026-03-03T16:56:53.740ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94112026-03-03T16:56:53.742ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94122026-03-03T16:56:53.742ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94132026-03-03T16:56:53.742ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94142026-03-03T16:56:53.742ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94152026-03-03T16:56:53.744ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94162026-03-03T16:56:53.749ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94172026-03-03T16:56:53.749ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94182026-03-03T16:56:53.749ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94192026-03-03T16:56:53.749ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94202026-03-03T16:56:53.749ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94212026-03-03T16:56:53.749ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94222026-03-03T16:56:53.751ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94232026-03-03T16:56:53.751ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94242026-03-03T16:56:53.751ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94252026-03-03T16:56:53.751ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94262026-03-03T16:56:53.753ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94272026-03-03T16:56:53.753ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94282026-03-03T16:56:53.753ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94292026-03-03T16:56:53.753ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94302026-03-03T16:56:53.756ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94312026-03-03T16:56:53.761ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94322026-03-03T16:56:53.761ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94332026-03-03T16:56:53.761ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94342026-03-03T16:56:53.761ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94352026-03-03T16:56:53.763ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94362026-03-03T16:56:53.763ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94372026-03-03T16:56:53.764ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94382026-03-03T16:56:53.765ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94392026-03-03T16:56:53.765ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94402026-03-03T16:56:53.766ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94412026-03-03T16:56:53.773ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94422026-03-03T16:56:53.773ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94432026-03-03T16:56:53.773ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94442026-03-03T16:56:53.773ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94452026-03-03T16:56:53.774ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94462026-03-03T16:56:53.774ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94472026-03-03T16:56:53.774ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94482026-03-03T16:56:53.774ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94492026-03-03T16:56:53.774ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94502026-03-03T16:56:53.774ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94512026-03-03T16:56:53.774ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94522026-03-03T16:56:53.774ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94532026-03-03T16:56:53.776ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94542026-03-03T16:56:53.776ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94552026-03-03T16:56:53.776ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94562026-03-03T16:56:53.776ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94572026-03-03T16:56:53.778ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94582026-03-03T16:56:53.783ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94592026-03-03T16:56:53.783ZTRACtest_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94602026-03-03T16:56:53.783ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94612026-03-03T16:56:53.783ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94622026-03-03T16:56:53.783ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94632026-03-03T16:56:53.784ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94642026-03-03T16:56:53.785ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94652026-03-03T16:56:53.785ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94662026-03-03T16:56:53.785ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94672026-03-03T16:56:53.786ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94682026-03-03T16:56:53.787ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94692026-03-03T16:56:53.788ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94702026-03-03T16:56:53.788ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94712026-03-03T16:56:53.788ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94722026-03-03T16:56:53.790ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94732026-03-03T16:56:53.795ZDEBGtest_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ByName("default") } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94742026-03-03T16:56:53.795ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94752026-03-03T16:56:53.795ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94762026-03-03T16:56:53.795ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94772026-03-03T16:56:53.798ZDEBGtest_metrics (nexus): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {Name("default"): [NetworkInterface { id: c6b76377-b80f-4757-ac27-e79841018bf2, kind: Instance { id: b95343ed-bbbf-4a5f-a176-4dea01521dba }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(1795622), primary: true, slot: 0 }]}
94782026-03-03T16:56:53.798ZDEBGtest_metrics (nexus): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c6b76377-b80f-4757-ac27-e79841018bf2, kind: Instance { id: b95343ed-bbbf-4a5f-a176-4dea01521dba }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(1795622), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(None)]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c6b76377-b80f-4757-ac27-e79841018bf2, kind: Instance { id: b95343ed-bbbf-4a5f-a176-4dea01521dba }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(1795622), primary: true, slot: 0 }], filter_hosts: Some({Vpc(Vni(1795622))}), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c6b76377-b80f-4757-ac27-e79841018bf2, kind: Instance { id: b95343ed-bbbf-4a5f-a176-4dea01521dba }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(1795622), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
94792026-03-03T16:56:53.798ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94802026-03-03T16:56:53.798ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94812026-03-03T16:56:53.799ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94822026-03-03T16:56:53.802ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94832026-03-03T16:56:53.803ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94842026-03-03T16:56:53.803ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94852026-03-03T16:56:53.805ZTRACtest_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94862026-03-03T16:56:53.805ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94872026-03-03T16:56:53.805ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94882026-03-03T16:56:53.805ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94892026-03-03T16:56:53.807ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94902026-03-03T16:56:53.809ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94912026-03-03T16:56:53.809ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94922026-03-03T16:56:53.809ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94932026-03-03T16:56:53.809ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94942026-03-03T16:56:53.812ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94952026-03-03T16:56:53.812ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94962026-03-03T16:56:53.812ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94972026-03-03T16:56:53.812ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94982026-03-03T16:56:53.814ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
94992026-03-03T16:56:53.819ZDEBGtest_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95002026-03-03T16:56:53.819ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95012026-03-03T16:56:53.819ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95022026-03-03T16:56:53.820ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95032026-03-03T16:56:53.831ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
95042026-03-03T16:56:53.831ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
95052026-03-03T16:56:53.831ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
95062026-03-03T16:56:53.833ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
95072026-03-03T16:56:53.835ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
95082026-03-03T16:56:53.835ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
95092026-03-03T16:56:53.835ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
95102026-03-03T16:56:53.835ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
95112026-03-03T16:56:53.837ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
95122026-03-03T16:56:53.843ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
95132026-03-03T16:56:53.844ZDEBGtest_metrics (nexus): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:33115/vmms/1620a67d-f446-4d32-8084-98dcaf9d53b1
95142026-03-03T16:56:53.845ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47686 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
95152026-03-03T16:56:53.845ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47686 req_id = 1af55c7c-a2bf-48b9-8b83-cc67b062b466 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1620a67d-f446-4d32-8084-98dcaf9d53b1
95162026-03-03T16:56:53.845ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47686 req_id = 1af55c7c-a2bf-48b9-8b83-cc67b062b466 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1620a67d-f446-4d32-8084-98dcaf9d53b1 version = 23.0.0
95172026-03-03T16:56:53.846ZINFOtest_metrics (SledAgent): created id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 initial_state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-03-03T16:56:53.843366772Z }, migration_in: None, migration_out: None } kind = instances server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
95182026-03-03T16:56:53.846ZINFOtest_metrics (dropshot): request completed latency_us = 1564 local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47686 req_id = 1af55c7c-a2bf-48b9-8b83-cc67b062b466 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1620a67d-f446-4d32-8084-98dcaf9d53b1
95192026-03-03T16:56:53.846ZDEBGtest_metrics (nexus): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:33115/vmms/1620a67d-f446-4d32-8084-98dcaf9d53b1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1af55c7c-a2bf-48b9-8b83-cc67b062b466", "content-length": "131", "date": "Tue, 03 Mar 2026 16:56:53 GMT"} })
95202026-03-03T16:56:53.846ZINFOtest_metrics (SagaExecutor): received new VMM runtime state from sled agent authenticated = true migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user vmm_state = VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-03-03T16:56:53.843366772Z }
95212026-03-03T16:56:53.846ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95222026-03-03T16:56:53.846ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95232026-03-03T16:56:53.847ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95242026-03-03T16:56:53.881ZDEBGtest_metrics (SEC): saga log event new_state = N020 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95252026-03-03T16:56:53.881ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("1620a67d-f446-4d32-8084-98dcaf9d53b1"), "instance_id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(2), "state": String("Starting"), "time_state_updated": String("2026-03-03T16:56:53.843366772Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T16:56:53.199577Z"), "time_deleted": Null}) node_id = 20 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95262026-03-03T16:56:53.883ZDEBGtest_metrics (SEC): saga log event new_state = N021 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95272026-03-03T16:56:53.883ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 21 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95282026-03-03T16:56:53.885ZINFOtest_metrics (SagaExecutor): start saga: updating multicast member sled_id instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_reason = AutoStart
95292026-03-03T16:56:53.885ZDEBGtest_metrics (SagaExecutor): multicast member lifecycle transition: updating sled_id authenticated = true instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba new_sled_id = Some(b6d65341-167c-41df-9b5c-41cded99c229 (sled)) operation = instance_start_or_migrate saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95302026-03-03T16:56:53.885ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95312026-03-03T16:56:53.885ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95322026-03-03T16:56:53.886ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95332026-03-03T16:56:53.915ZDEBGtest_metrics (SEC): saga log event new_state = N021 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95342026-03-03T16:56:53.915ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 21 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95352026-03-03T16:56:53.918ZDEBGtest_metrics (SEC): saga log event new_state = N022 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95362026-03-03T16:56:53.918ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 22 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95372026-03-03T16:56:53.919ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = AddVirtualResources silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95382026-03-03T16:56:53.919ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = AddVirtualResources silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95392026-03-03T16:56:53.920ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = AddVirtualResources silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95402026-03-03T16:56:53.926ZDEBGtest_metrics (SEC): saga log event new_state = N022 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95412026-03-03T16:56:53.926ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 22 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95422026-03-03T16:56:53.927ZDEBGtest_metrics (SEC): saga log event new_state = N023 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95432026-03-03T16:56:53.927ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 23 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95442026-03-03T16:56:53.929ZINFOtest_metrics (SagaExecutor): start saga: ensuring instance is running instance_id = b95343ed-bbbf-4a5f-a176-4dea01521dba saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_reason = AutoStart
95452026-03-03T16:56:53.937ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
95462026-03-03T16:56:53.938ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
95472026-03-03T16:56:53.938ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
95482026-03-03T16:56:53.941ZTRACtest_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
95492026-03-03T16:56:53.941ZTRACtest_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
95502026-03-03T16:56:53.941ZTRACtest_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
95512026-03-03T16:56:53.941ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
95522026-03-03T16:56:53.942ZDEBGtest_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
95532026-03-03T16:56:53.943ZDEBGtest_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
95542026-03-03T16:56:53.947ZDEBGtest_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
95552026-03-03T16:56:53.947ZDEBGtest_metrics (nexus): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:33115/vmms/1620a67d-f446-4d32-8084-98dcaf9d53b1/state
95562026-03-03T16:56:53.947ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47688 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
95572026-03-03T16:56:53.947ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47688 req_id = 40748614-18b5-4b40-b053-7d989e459177 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1620a67d-f446-4d32-8084-98dcaf9d53b1/state
95582026-03-03T16:56:53.947ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47688 req_id = 40748614-18b5-4b40-b053-7d989e459177 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1620a67d-f446-4d32-8084-98dcaf9d53b1/state version = 23.0.0
95592026-03-03T16:56:53.948ZINFOtest_metrics (SledAgent): noop transition id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 kind = instances server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 target = Running
95602026-03-03T16:56:53.948ZINFOtest_metrics (dropshot): request completed latency_us = 343 local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47688 req_id = 40748614-18b5-4b40-b053-7d989e459177 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/1620a67d-f446-4d32-8084-98dcaf9d53b1/state
95612026-03-03T16:56:53.948ZDEBGtest_metrics (nexus): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:33115/vmms/1620a67d-f446-4d32-8084-98dcaf9d53b1/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "40748614-18b5-4b40-b053-7d989e459177", "content-length": "151", "date": "Tue, 03 Mar 2026 16:56:53 GMT"} })
95622026-03-03T16:56:53.948ZINFOtest_metrics (SagaExecutor): received new VMM runtime state from sled agent authenticated = true migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 1620a67d-f446-4d32-8084-98dcaf9d53b1 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user vmm_state = VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-03-03T16:56:53.843366772Z }
95632026-03-03T16:56:53.948ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95642026-03-03T16:56:53.948ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95652026-03-03T16:56:53.949ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
95662026-03-03T16:56:53.954ZDEBGtest_metrics (SEC): saga log event new_state = N023 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95672026-03-03T16:56:53.954ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 23 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95682026-03-03T16:56:53.956ZDEBGtest_metrics (SEC): saga log event new_state = N025 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
95692026-03-03T16:56:53.956ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 25 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95702026-03-03T16:56:53.957ZDEBGtest_metrics (SEC): saga log event new_state = N025 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
95712026-03-03T16:56:53.958ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 25 saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95722026-03-03T16:56:53.959ZINFOtest_metrics (SEC): update for saga cached state new_state = Done saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b sec_id = 913233fe-92a8-4635-9572-183f495429c4
95732026-03-03T16:56:53.959ZINFOtest_metrics (SecStore): updating state new_state = done saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95742026-03-03T16:56:53.962ZINFOtest_metrics (SEC): saga finished result = success saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start sec_id = 913233fe-92a8-4635-9572-183f495429c4
95752026-03-03T16:56:53.962ZINFOtest_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b
95762026-03-03T16:56:53.962ZINFOtest_metrics (SagaExecutor): saga finished saga_id = 3b606c0a-a7c3-41e5-ae24-28eb7655b65b saga_name = instance-start saga_result = SagaResult { saga_id: 3b606c0a-a7c3-41e5-ae24-28eb7655b65b, saga_log: SagaLog { saga_id: 3b606c0a-a7c3-41e5-ae24-28eb7655b65b, unwinding: false, events: [N024 started, N024 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N017 started, N017 succeeded, N016 started, N016 succeeded, N015 started, N015 succeeded, N014 started, N014 succeeded, N013 started, N013 succeeded, N012 started, N012 succeeded, N011 started, N011 succeeded, N010 started, N010 succeeded, N009 started, N009 succeeded, N008 started, N008 succeeded, N007 started, N007 succeeded, N006 started, N006 succeeded, N018 started, N018 succeeded, N019 started, N019 succeeded, N020 started, N020 succeeded, N021 started, N021 succeeded, N022 started, N022 succeeded, N023 started, N023 succeeded, N025 started, N025 succeeded], node_status: {0: Succeeded(String("1620a67d-f446-4d32-8084-98dcaf9d53b1")), 1: Succeeded(String("b6d65341-167c-41df-9b5c-41cded99c229")), 2: Succeeded(String("::1:0")), 3: Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("1620a67d-f446-4d32-8084-98dcaf9d53b1"), "instance_id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(1), "state": String("Creating"), "time_state_updated": String("2026-03-03T16:56:53.199577Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T16:56:53.199577Z"), "time_deleted": Null}), 4: Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "name": String("i-1"), "time_created": String("2026-03-03T16:56:52.501063Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:52.501063Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(3), "migration_id": Null, "nexus_state": String("Vmm"), "propolis_id": String("1620a67d-f446-4d32-8084-98dcaf9d53b1"), "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T16:56:52.501063Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}), 5: Succeeded(Array []), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null), 15: Succeeded(Null), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null), 20: Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("1620a67d-f446-4d32-8084-98dcaf9d53b1"), "instance_id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(2), "state": String("Starting"), "time_state_updated": String("2026-03-03T16:56:53.843366772Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T16:56:53.199577Z"), "time_deleted": Null}), 21: Succeeded(Null), 22: Succeeded(Null), 23: Succeeded(Null), 24: Succeeded(Null), 25: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"dpd_ensure": Null, "ensure_local_storage_0": Null, "ensure_local_storage_1": Null, "ensure_local_storage_10": Null, "ensure_local_storage_11": Null, "ensure_local_storage_2": Null, "ensure_local_storage_3": Null, "ensure_local_storage_4": Null, "ensure_local_storage_5": Null, "ensure_local_storage_6": Null, "ensure_local_storage_7": Null, "ensure_local_storage_8": Null, "ensure_local_storage_9": Null, "ensure_registered": Object {"cpu_platform": String("AmdMilan"), "id": String("1620a67d-f446-4d32-8084-98dcaf9d53b1"), "instance_id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(2), "state": String("Starting"), "time_state_updated": String("2026-03-03T16:56:53.843366772Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T16:56:53.199577Z"), "time_deleted": Null}, "ensure_running": Null, "local_storage_records": Array [], "multicast_sled_id": Null, "propolis_id": String("1620a67d-f446-4d32-8084-98dcaf9d53b1"), "propolis_ip": String("::1:0"), "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "started_record": Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"i-1\\""), "id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "name": String("i-1"), "time_created": String("2026-03-03T16:56:52.501063Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:52.501063Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(3), "migration_id": Null, "nexus_state": String("Vmm"), "propolis_id": String("1620a67d-f446-4d32-8084-98dcaf9d53b1"), "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T16:56:52.501063Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}, "v2p_ensure": Null, "virtual_resources": Null, "vmm_record": Object {"cpu_platform": String("AmdMilan"), "id": String("1620a67d-f446-4d32-8084-98dcaf9d53b1"), "instance_id": String("b95343ed-bbbf-4a5f-a176-4dea01521dba"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(1), "state": String("Creating"), "time_state_updated": String("2026-03-03T16:56:53.199577Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T16:56:53.199577Z"), "time_deleted": Null}} }) }
95772026-03-03T16:56:53.962ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
95782026-03-03T16:56:53.962ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
95792026-03-03T16:56:53.962ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
95802026-03-03T16:56:53.962ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
95812026-03-03T16:56:53.963ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
95822026-03-03T16:56:53.963ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 7 reason = Signaled
95832026-03-03T16:56:53.963ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
95842026-03-03T16:56:53.963ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
95852026-03-03T16:56:53.963ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
95862026-03-03T16:56:53.964ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: f0 25 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .%..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:37126 req_id = 1f5754ef-6998-412c-9533-315062efaa5d
95872026-03-03T16:56:53.964ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 61477,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:37126 req_id = 1f5754ef-6998-412c-9533-315062efaa5d
95882026-03-03T16:56:53.964ZDEBGtest_metrics (store): query key key = _dendrite._tcp
95892026-03-03T16:56:53.964ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
95902026-03-03T16:56:53.964ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:37126 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 1f5754ef-6998-412c-9533-315062efaa5d
95912026-03-03T16:56:53.965ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1876, tv_nsec: 221470203 } })
95922026-03-03T16:56:53.965ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
95932026-03-03T16:56:53.965ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 61 80 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e a...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:64135 req_id = 5baab6f5-7130-4dc0-9771-8019cb412b0a
95942026-03-03T16:56:53.965ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 24960,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:64135 req_id = 5baab6f5-7130-4dc0-9771-8019cb412b0a
95952026-03-03T16:56:53.965ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
95962026-03-03T16:56:53.965ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:64135 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 5baab6f5-7130-4dc0-9771-8019cb412b0a
95972026-03-03T16:56:53.984ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:42205/switch/identifiers
95982026-03-03T16:56:53.985ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
95992026-03-03T16:56:53.985ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96002026-03-03T16:56:53.985ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96012026-03-03T16:56:53.985ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96022026-03-03T16:56:53.987ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:42205/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "e97b9db1-ee4b-43ea-bf60-dae9da431455", "content-length": "206", "date": "Tue, 03 Mar 2026 16:56:53 GMT"} })
96032026-03-03T16:56:53.987ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
96042026-03-03T16:56:53.987ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
96052026-03-03T16:56:53.987ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
96062026-03-03T16:56:53.987ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
96072026-03-03T16:56:53.988ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96082026-03-03T16:56:53.988ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96092026-03-03T16:56:53.988ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96102026-03-03T16:56:53.988ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96112026-03-03T16:56:53.989ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
96122026-03-03T16:56:53.989ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
96132026-03-03T16:56:53.989ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
96142026-03-03T16:56:53.989ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
96152026-03-03T16:56:53.990ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
96162026-03-03T16:56:53.991ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96172026-03-03T16:56:53.996ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96182026-03-03T16:56:53.996ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96192026-03-03T16:56:53.996ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96202026-03-03T16:56:53.996ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96212026-03-03T16:56:53.998ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
96222026-03-03T16:56:53.998ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
96232026-03-03T16:56:53.998ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
96242026-03-03T16:56:53.998ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
96252026-03-03T16:56:53.999ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
96262026-03-03T16:56:53.999ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96272026-03-03T16:56:53.999ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96282026-03-03T16:56:54.000ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96292026-03-03T16:56:54.000ZDEBGtest_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Signaled
96302026-03-03T16:56:54.000ZINFOtest_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
96312026-03-03T16:56:54.000ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
96322026-03-03T16:56:54.000ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
96332026-03-03T16:56:54.000ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
96342026-03-03T16:56:54.000ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96352026-03-03T16:56:54.000ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96362026-03-03T16:56:54.006ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96372026-03-03T16:56:54.006ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96382026-03-03T16:56:54.007ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96392026-03-03T16:56:54.008ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96402026-03-03T16:56:54.011ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96412026-03-03T16:56:54.011ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
96422026-03-03T16:56:54.011ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
96432026-03-03T16:56:54.011ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
96442026-03-03T16:56:54.011ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96452026-03-03T16:56:54.011ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96462026-03-03T16:56:54.011ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
96472026-03-03T16:56:54.011ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
96482026-03-03T16:56:54.011ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
96492026-03-03T16:56:54.011ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
96502026-03-03T16:56:54.012ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
96512026-03-03T16:56:54.020ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96522026-03-03T16:56:54.023ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96532026-03-03T16:56:54.023ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
96542026-03-03T16:56:54.023ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96552026-03-03T16:56:54.023ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96562026-03-03T16:56:54.024ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96572026-03-03T16:56:54.024ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96582026-03-03T16:56:54.027ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96592026-03-03T16:56:54.030ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96602026-03-03T16:56:54.030ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96612026-03-03T16:56:54.030ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96622026-03-03T16:56:54.030ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96632026-03-03T16:56:54.030ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96642026-03-03T16:56:54.039ZINFOtest_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
96652026-03-03T16:56:54.039ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:33115/vpc-routes
96662026-03-03T16:56:54.039ZINFOtest_metrics (dropshot): accepted connection local_addr = [::1]:33115 remote_addr = [::1]:47690 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
96672026-03-03T16:56:54.040ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = GET remote_addr = [::1]:47690 req_id = a0b6a66e-da2b-4910-8bdc-7b917be87ec6 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
96682026-03-03T16:56:54.040ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = GET remote_addr = [::1]:47690 req_id = a0b6a66e-da2b-4910-8bdc-7b917be87ec6 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
96692026-03-03T16:56:54.040ZINFOtest_metrics (dropshot): request completed latency_us = 400 local_addr = [::1]:33115 method = GET remote_addr = [::1]:47690 req_id = a0b6a66e-da2b-4910-8bdc-7b917be87ec6 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
96702026-03-03T16:56:54.041ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:33115/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0b6a66e-da2b-4910-8bdc-7b917be87ec6", "content-length": "152", "date": "Tue, 03 Mar 2026 16:56:54 GMT"} })
96712026-03-03T16:56:54.041ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
96722026-03-03T16:56:54.041ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96732026-03-03T16:56:54.041ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96742026-03-03T16:56:54.042ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96752026-03-03T16:56:54.042ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96762026-03-03T16:56:54.042ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96772026-03-03T16:56:54.042ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96782026-03-03T16:56:54.045ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96792026-03-03T16:56:54.045ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96802026-03-03T16:56:54.045ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96812026-03-03T16:56:54.046ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96822026-03-03T16:56:54.049ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
96832026-03-03T16:56:54.049ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
96842026-03-03T16:56:54.049ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
96852026-03-03T16:56:54.050ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
96862026-03-03T16:56:54.050ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96872026-03-03T16:56:54.055ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96882026-03-03T16:56:54.055ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96892026-03-03T16:56:54.055ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96902026-03-03T16:56:54.055ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96912026-03-03T16:56:54.055ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96922026-03-03T16:56:54.056ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
96932026-03-03T16:56:54.056ZINFOtest_metrics (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = SimGimlet00
96942026-03-03T16:56:54.056ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:33115/eip-gateways
96952026-03-03T16:56:54.057ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47690 req_id = 37b1da61-ce77-4bb2-af5d-94b8ea912d2f sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
96962026-03-03T16:56:54.057ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47690 req_id = 37b1da61-ce77-4bb2-af5d-94b8ea912d2f sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways version = 23.0.0
96972026-03-03T16:56:54.057ZINFOtest_metrics (dropshot): request completed latency_us = 230 local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47690 req_id = 37b1da61-ce77-4bb2-af5d-94b8ea912d2f response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
96982026-03-03T16:56:54.058ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:33115/eip-gateways", status: 204, headers: {"x-request-id": "37b1da61-ce77-4bb2-af5d-94b8ea912d2f", "date": "Tue, 03 Mar 2026 16:56:54 GMT"} })
96992026-03-03T16:56:54.058ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
97002026-03-03T16:56:54.058ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97012026-03-03T16:56:54.059ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97022026-03-03T16:56:54.059ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
97032026-03-03T16:56:54.059ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
97042026-03-03T16:56:54.059ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
97052026-03-03T16:56:54.059ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
97062026-03-03T16:56:54.060ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
97072026-03-03T16:56:54.060ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97082026-03-03T16:56:54.060ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97092026-03-03T16:56:54.060ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97102026-03-03T16:56:54.060ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97112026-03-03T16:56:54.063ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
97122026-03-03T16:56:54.063ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
97132026-03-03T16:56:54.064ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
97142026-03-03T16:56:54.064ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 100.97185ms iteration = 7 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
97152026-03-03T16:56:54.064ZDEBGtest_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 8 reason = Signaled
97162026-03-03T16:56:54.065ZTRACtest_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
97172026-03-03T16:56:54.065ZTRACtest_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
97182026-03-03T16:56:54.065ZTRACtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
97192026-03-03T16:56:54.066ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
97202026-03-03T16:56:54.066ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97212026-03-03T16:56:54.066ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97222026-03-03T16:56:54.067ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97232026-03-03T16:56:54.067ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97242026-03-03T16:56:54.067ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97252026-03-03T16:56:54.067ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97262026-03-03T16:56:54.069ZTRACtest_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 0e 36 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .6..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:12975 req_id = 44357edc-89fb-45f9-ba4d-bac3eac2ac87
97272026-03-03T16:56:54.070ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 3638,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:12975 req_id = 44357edc-89fb-45f9-ba4d-bac3eac2ac87
97282026-03-03T16:56:54.070ZDEBGtest_metrics (store): query key key = _dendrite._tcp
97292026-03-03T16:56:54.070ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
97302026-03-03T16:56:54.070ZDEBGtest_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:12975 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 44357edc-89fb-45f9-ba4d-bac3eac2ac87
97312026-03-03T16:56:54.070ZDEBGtest_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 42205, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1876, tv_nsec: 327154161 } })
97322026-03-03T16:56:54.070ZTRACtest_metrics (DnsResolver): lookup_service_targets: looking up SRV target
97332026-03-03T16:56:54.072ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97342026-03-03T16:56:54.077ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: b95343ed-bbbf-4a5f-a176-4dea01521dba, lookup_type: ById(b95343ed-bbbf-4a5f-a176-4dea01521dba) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97352026-03-03T16:56:54.077ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97362026-03-03T16:56:54.077ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97372026-03-03T16:56:54.078ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97382026-03-03T16:56:54.078ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
97392026-03-03T16:56:54.078ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97402026-03-03T16:56:54.079ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97412026-03-03T16:56:54.079ZTRACtest_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: db ce 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:3296 req_id = 372d646e-6526-4c1b-a2e0-f4809f8de487
97422026-03-03T16:56:54.079ZDEBGtest_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56270,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:3296 req_id = 372d646e-6526-4c1b-a2e0-f4809f8de487
97432026-03-03T16:56:54.079ZDEBGtest_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
97442026-03-03T16:56:54.080ZDEBGtest_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:3296 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 372d646e-6526-4c1b-a2e0-f4809f8de487
97452026-03-03T16:56:54.098ZTRACtest_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:42205/switch/identifiers
97462026-03-03T16:56:54.099ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97472026-03-03T16:56:54.099ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97482026-03-03T16:56:54.099ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97492026-03-03T16:56:54.099ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97502026-03-03T16:56:54.100ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97512026-03-03T16:56:54.100ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
97522026-03-03T16:56:54.100ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97532026-03-03T16:56:54.101ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97542026-03-03T16:56:54.101ZTRACtest_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:42205/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa55a17b-a944-4c58-a548-677e46a04d3c", "content-length": "206", "date": "Tue, 03 Mar 2026 16:56:54 GMT"} })
97552026-03-03T16:56:54.102ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
97562026-03-03T16:56:54.102ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
97572026-03-03T16:56:54.102ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
97582026-03-03T16:56:54.102ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
97592026-03-03T16:56:54.102ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97602026-03-03T16:56:54.104ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97612026-03-03T16:56:54.104ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97622026-03-03T16:56:54.104ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97632026-03-03T16:56:54.104ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=p-1
97642026-03-03T16:56:54.105ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
97652026-03-03T16:56:54.105ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97662026-03-03T16:56:54.105ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97672026-03-03T16:56:54.105ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
97682026-03-03T16:56:54.105ZTRACtest_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
97692026-03-03T16:56:54.106ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
97702026-03-03T16:56:54.106ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
97712026-03-03T16:56:54.106ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
97722026-03-03T16:56:54.107ZINFOtest_metrics (dropshot_external): request completed latency_us = 1698358 local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = d75df0e0-d17e-4e2e-97b8-affad3f63884 response_code = 201 uri = /v1/instances?project=p-1
97732026-03-03T16:56:54.107ZINFOtest_metrics (external client test context): client received response status = 201
97742026-03-03T16:56:54.107ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
97752026-03-03T16:56:54.107ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
97762026-03-03T16:56:54.107ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
97772026-03-03T16:56:54.107ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
97782026-03-03T16:56:54.107ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
97792026-03-03T16:56:54.107ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
97802026-03-03T16:56:54.107ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
97812026-03-03T16:56:54.107ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
97822026-03-03T16:56:54.107ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97832026-03-03T16:56:54.108ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97842026-03-03T16:56:54.108ZDEBGtest_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
97852026-03-03T16:56:54.108ZTRACtest_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
97862026-03-03T16:56:54.108ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
97872026-03-03T16:56:54.108ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
97882026-03-03T16:56:54.109ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
97892026-03-03T16:56:54.109ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
97902026-03-03T16:56:54.109ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10 version = 2026021900.0.0
97912026-03-03T16:56:54.109ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = f4b063dc-ddef-421b-ad5f-eaea651a19e3 uri = /913233fe-92a8-4635-9572-183f495429c4
97922026-03-03T16:56:54.109ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
97932026-03-03T16:56:54.109ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
97942026-03-03T16:56:54.109ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97952026-03-03T16:56:54.109ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97962026-03-03T16:56:54.110ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97972026-03-03T16:56:54.116ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6466 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = f4b063dc-ddef-421b-ad5f-eaea651a19e3 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
97982026-03-03T16:56:54.116ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
97992026-03-03T16:56:54.116ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98002026-03-03T16:56:54.116ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98012026-03-03T16:56:54.117ZDEBGtest_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
98022026-03-03T16:56:54.117ZTRACtest_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
98032026-03-03T16:56:54.117ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
98042026-03-03T16:56:54.117ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
98052026-03-03T16:56:54.117ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
98062026-03-03T16:56:54.117ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
98072026-03-03T16:56:54.117ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
98082026-03-03T16:56:54.118ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
98092026-03-03T16:56:54.118ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) }, key: b7b34caf-70bf-442a-8106-d354c3fece87, lookup_type: ById(b7b34caf-70bf-442a-8106-d354c3fece87) }
98102026-03-03T16:56:54.118ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project
98112026-03-03T16:56:54.118ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
98122026-03-03T16:56:54.118ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98132026-03-03T16:56:54.119ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98142026-03-03T16:56:54.119ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
98152026-03-03T16:56:54.128ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
98162026-03-03T16:56:54.128ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
98172026-03-03T16:56:54.128ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
98182026-03-03T16:56:54.128ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
98192026-03-03T16:56:54.128ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
98202026-03-03T16:56:54.128ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
98212026-03-03T16:56:54.128ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
98222026-03-03T16:56:54.129ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
98232026-03-03T16:56:54.129ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
98242026-03-03T16:56:54.129ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
98252026-03-03T16:56:54.129ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
98262026-03-03T16:56:54.129ZDEBGtest_metrics (results-sink): inserting 22 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
98272026-03-03T16:56:54.129ZDEBGtest_metrics (results-sink-cluster): inserting 22 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
98282026-03-03T16:56:54.130ZDEBGtest_metrics (clickhouse-client): unrolling 22 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
98292026-03-03T16:56:54.137ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
98302026-03-03T16:56:54.137ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
98312026-03-03T16:56:54.137ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
98322026-03-03T16:56:54.137ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
98332026-03-03T16:56:54.137ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
98342026-03-03T16:56:54.138ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
98352026-03-03T16:56:54.138ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
98362026-03-03T16:56:54.139ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
98372026-03-03T16:56:54.139ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98382026-03-03T16:56:54.139ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98392026-03-03T16:56:54.139ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
98402026-03-03T16:56:54.139ZTRACtest_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
98412026-03-03T16:56:54.139ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
98422026-03-03T16:56:54.139ZDEBGtest_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
98432026-03-03T16:56:54.140ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
98442026-03-03T16:56:54.141ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
98452026-03-03T16:56:54.141ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
98462026-03-03T16:56:54.141ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
98472026-03-03T16:56:54.141ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
98482026-03-03T16:56:54.141ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
98492026-03-03T16:56:54.141ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
98502026-03-03T16:56:54.141ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98512026-03-03T16:56:54.142ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98522026-03-03T16:56:54.142ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 32 table_name = fields_string
98532026-03-03T16:56:54.142ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
98542026-03-03T16:56:54.143ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
98552026-03-03T16:56:54.146ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
98562026-03-03T16:56:54.146ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
98572026-03-03T16:56:54.146ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
98582026-03-03T16:56:54.146ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
98592026-03-03T16:56:54.147ZTRACtest_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
98602026-03-03T16:56:54.147ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
98612026-03-03T16:56:54.148ZTRACtest_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
98622026-03-03T16:56:54.148ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 83.688783ms iteration = 8 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
98632026-03-03T16:56:54.148ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98642026-03-03T16:56:54.156ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) }, key: b7b34caf-70bf-442a-8106-d354c3fece87, lookup_type: ById(b7b34caf-70bf-442a-8106-d354c3fece87) } result = Ok(())
98652026-03-03T16:56:54.156ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "VpcRouter" using built-in user background_task = vpc_route_manager
98662026-03-03T16:56:54.156ZTRACtest_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) }, key: b7b34caf-70bf-442a-8106-d354c3fece87, lookup_type: ById(b7b34caf-70bf-442a-8106-d354c3fece87) }
98672026-03-03T16:56:54.156ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project
98682026-03-03T16:56:54.156ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
98692026-03-03T16:56:54.156ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98702026-03-03T16:56:54.157ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98712026-03-03T16:56:54.158ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_u16
98722026-03-03T16:56:54.158ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 21 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
98732026-03-03T16:56:54.158ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
98742026-03-03T16:56:54.158ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
98752026-03-03T16:56:54.158ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
98762026-03-03T16:56:54.158ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
98772026-03-03T16:56:54.159ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
98782026-03-03T16:56:54.160ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
98792026-03-03T16:56:54.160ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
98802026-03-03T16:56:54.160ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98812026-03-03T16:56:54.160ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98822026-03-03T16:56:54.161ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
98832026-03-03T16:56:54.161ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
98842026-03-03T16:56:54.161ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
98852026-03-03T16:56:54.161ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
98862026-03-03T16:56:54.162ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 21 table_name = fields_uuid
98872026-03-03T16:56:54.162ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
98882026-03-03T16:56:54.163ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
98892026-03-03T16:56:54.163ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
98902026-03-03T16:56:54.163ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98912026-03-03T16:56:54.163ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98922026-03-03T16:56:54.163ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
98932026-03-03T16:56:54.165ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
98942026-03-03T16:56:54.165ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
98952026-03-03T16:56:54.165ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
98962026-03-03T16:56:54.165ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
98972026-03-03T16:56:54.165ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
98982026-03-03T16:56:54.165ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
98992026-03-03T16:56:54.166ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99002026-03-03T16:56:54.169ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = measurements_histogramu64
99012026-03-03T16:56:54.169ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 7 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
99022026-03-03T16:56:54.170ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99032026-03-03T16:56:54.182ZDEBGtest_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) }, key: b7b34caf-70bf-442a-8106-d354c3fece87, lookup_type: ById(b7b34caf-70bf-442a-8106-d354c3fece87) } result = Ok(())
99042026-03-03T16:56:54.182ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99052026-03-03T16:56:54.182ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99062026-03-03T16:56:54.182ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99072026-03-03T16:56:54.182ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99082026-03-03T16:56:54.183ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99092026-03-03T16:56:54.183ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99102026-03-03T16:56:54.183ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99112026-03-03T16:56:54.183ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99122026-03-03T16:56:54.183ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99132026-03-03T16:56:54.183ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99142026-03-03T16:56:54.183ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99152026-03-03T16:56:54.185ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99162026-03-03T16:56:54.185ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99172026-03-03T16:56:54.185ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99182026-03-03T16:56:54.185ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99192026-03-03T16:56:54.186ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 7 table_name = measurements_i64
99202026-03-03T16:56:54.186ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
99212026-03-03T16:56:54.186ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
99222026-03-03T16:56:54.186ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
99232026-03-03T16:56:54.187ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
99242026-03-03T16:56:54.187ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99252026-03-03T16:56:54.187ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99262026-03-03T16:56:54.187ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99272026-03-03T16:56:54.188ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99282026-03-03T16:56:54.188ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99292026-03-03T16:56:54.188ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99302026-03-03T16:56:54.190ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99312026-03-03T16:56:54.190ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99322026-03-03T16:56:54.190ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99332026-03-03T16:56:54.190ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99342026-03-03T16:56:54.190ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99352026-03-03T16:56:54.190ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99362026-03-03T16:56:54.190ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99372026-03-03T16:56:54.190ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99382026-03-03T16:56:54.191ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
99392026-03-03T16:56:54.191ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
99402026-03-03T16:56:54.191ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99412026-03-03T16:56:54.191ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99422026-03-03T16:56:54.192ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99432026-03-03T16:56:54.192ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99442026-03-03T16:56:54.192ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99452026-03-03T16:56:54.192ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99462026-03-03T16:56:54.193ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99472026-03-03T16:56:54.194ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
99482026-03-03T16:56:54.194ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
99492026-03-03T16:56:54.194ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) }, key: 453a352b-10aa-4873-adc2-4d11e650f92f, lookup_type: ById(453a352b-10aa-4873-adc2-4d11e650f92f) }
99502026-03-03T16:56:54.194ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project
99512026-03-03T16:56:54.194ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99522026-03-03T16:56:54.194ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99532026-03-03T16:56:54.195ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99542026-03-03T16:56:54.195ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99552026-03-03T16:56:54.195ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99562026-03-03T16:56:54.195ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99572026-03-03T16:56:54.196ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99582026-03-03T16:56:54.197ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
99592026-03-03T16:56:54.198ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99602026-03-03T16:56:54.198ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99612026-03-03T16:56:54.198ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99622026-03-03T16:56:54.198ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99632026-03-03T16:56:54.202ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99642026-03-03T16:56:54.202ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99652026-03-03T16:56:54.202ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99662026-03-03T16:56:54.202ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99672026-03-03T16:56:54.202ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99682026-03-03T16:56:54.202ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99692026-03-03T16:56:54.204ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
99702026-03-03T16:56:54.204ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99712026-03-03T16:56:54.204ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99722026-03-03T16:56:54.204ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99732026-03-03T16:56:54.204ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99742026-03-03T16:56:54.204ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99752026-03-03T16:56:54.204ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99762026-03-03T16:56:54.205ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99772026-03-03T16:56:54.206ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99782026-03-03T16:56:54.211ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) }, key: 453a352b-10aa-4873-adc2-4d11e650f92f, lookup_type: ById(453a352b-10aa-4873-adc2-4d11e650f92f) } result = Ok(())
99792026-03-03T16:56:54.211ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = vpc_route_manager
99802026-03-03T16:56:54.211ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99812026-03-03T16:56:54.212ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99822026-03-03T16:56:54.212ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99832026-03-03T16:56:54.212ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99842026-03-03T16:56:54.214ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
99852026-03-03T16:56:54.216ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '41c1c314-b812-4fb3-ab31-28abfa63ce10') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
99862026-03-03T16:56:54.217ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99872026-03-03T16:56:54.217ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99882026-03-03T16:56:54.217ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99892026-03-03T16:56:54.218ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99902026-03-03T16:56:54.219ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99912026-03-03T16:56:54.219ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99922026-03-03T16:56:54.220ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (177066575428309413) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.107478651' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
99932026-03-03T16:56:54.220ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99942026-03-03T16:56:54.220ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99952026-03-03T16:56:54.221ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99962026-03-03T16:56:54.222ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) }, key: 453a352b-10aa-4873-adc2-4d11e650f92f, lookup_type: ByName("default") }
99972026-03-03T16:56:54.222ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project
99982026-03-03T16:56:54.222ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
99992026-03-03T16:56:54.222ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100002026-03-03T16:56:54.223ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100012026-03-03T16:56:54.224ZINFOtest_metrics (dropshot_external): request completed latency_us = 114877 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = f2f7fa57-b2a8-45ff-a128-a5aca841618c response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.107478651Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100022026-03-03T16:56:54.225ZINFOtest_metrics (external client test context): client received response status = 200
100032026-03-03T16:56:54.225ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100042026-03-03T16:56:54.225ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
100052026-03-03T16:56:54.225ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
100062026-03-03T16:56:54.225ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
100072026-03-03T16:56:54.225ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
100082026-03-03T16:56:54.225ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
100092026-03-03T16:56:54.225ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
100102026-03-03T16:56:54.225ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
100112026-03-03T16:56:54.225ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
100122026-03-03T16:56:54.225ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100132026-03-03T16:56:54.226ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100142026-03-03T16:56:54.226ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100152026-03-03T16:56:54.226ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10 version = 2026021900.0.0
100162026-03-03T16:56:54.226ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 60bd37e4-fe58-42c4-92dc-22a010e24104 uri = /913233fe-92a8-4635-9572-183f495429c4
100172026-03-03T16:56:54.227ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100182026-03-03T16:56:54.227ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100192026-03-03T16:56:54.227ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
100202026-03-03T16:56:54.227ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
100212026-03-03T16:56:54.227ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
100222026-03-03T16:56:54.233ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6742 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 60bd37e4-fe58-42c4-92dc-22a010e24104 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
100232026-03-03T16:56:54.233ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
100242026-03-03T16:56:54.242ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
100252026-03-03T16:56:54.242ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
100262026-03-03T16:56:54.242ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
100272026-03-03T16:56:54.242ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
100282026-03-03T16:56:54.243ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
100292026-03-03T16:56:54.243ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
100302026-03-03T16:56:54.243ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
100312026-03-03T16:56:54.243ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
100322026-03-03T16:56:54.243ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
100332026-03-03T16:56:54.243ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
100342026-03-03T16:56:54.243ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
100352026-03-03T16:56:54.249ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
100362026-03-03T16:56:54.249ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
100372026-03-03T16:56:54.249ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
100382026-03-03T16:56:54.249ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100392026-03-03T16:56:54.250ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100402026-03-03T16:56:54.250ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
100412026-03-03T16:56:54.250ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
100422026-03-03T16:56:54.251ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
100432026-03-03T16:56:54.252ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 30 table_name = fields_string
100442026-03-03T16:56:54.252ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
100452026-03-03T16:56:54.252ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100462026-03-03T16:56:54.258ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) }, key: 453a352b-10aa-4873-adc2-4d11e650f92f, lookup_type: ByName("default") } result = Ok(())
100472026-03-03T16:56:54.270ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = vpc_route_manager
100482026-03-03T16:56:54.270ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
100492026-03-03T16:56:54.270ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100502026-03-03T16:56:54.270ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100512026-03-03T16:56:54.270ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
100522026-03-03T16:56:54.270ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
100532026-03-03T16:56:54.270ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
100542026-03-03T16:56:54.270ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
100552026-03-03T16:56:54.270ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
100562026-03-03T16:56:54.270ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
100572026-03-03T16:56:54.270ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100582026-03-03T16:56:54.270ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100592026-03-03T16:56:54.270ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
100602026-03-03T16:56:54.270ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
100612026-03-03T16:56:54.270ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
100622026-03-03T16:56:54.270ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
100632026-03-03T16:56:54.270ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
100642026-03-03T16:56:54.270ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100652026-03-03T16:56:54.271ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100662026-03-03T16:56:54.271ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
100672026-03-03T16:56:54.271ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
100682026-03-03T16:56:54.271ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
100692026-03-03T16:56:54.271ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
100702026-03-03T16:56:54.271ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
100712026-03-03T16:56:54.271ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
100722026-03-03T16:56:54.271ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100732026-03-03T16:56:54.271ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100742026-03-03T16:56:54.271ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
100752026-03-03T16:56:54.271ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
100762026-03-03T16:56:54.271ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
100772026-03-03T16:56:54.271ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
100782026-03-03T16:56:54.271ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
100792026-03-03T16:56:54.271ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
100802026-03-03T16:56:54.271ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
100812026-03-03T16:56:54.271ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
100822026-03-03T16:56:54.271ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
100832026-03-03T16:56:54.271ZTRACtest_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) }, key: 87b75148-24ab-4643-8655-087620cab27b, lookup_type: ByName("default") }
100842026-03-03T16:56:54.271ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project
100852026-03-03T16:56:54.271ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
100862026-03-03T16:56:54.271ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100872026-03-03T16:56:54.271ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100882026-03-03T16:56:54.271ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_u16
100892026-03-03T16:56:54.271ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
100902026-03-03T16:56:54.271ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
100912026-03-03T16:56:54.273ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
100922026-03-03T16:56:54.273ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100932026-03-03T16:56:54.273ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100942026-03-03T16:56:54.273ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100952026-03-03T16:56:54.273ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100962026-03-03T16:56:54.273ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100972026-03-03T16:56:54.274ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
100982026-03-03T16:56:54.274ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
100992026-03-03T16:56:54.274ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101002026-03-03T16:56:54.274ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101012026-03-03T16:56:54.274ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101022026-03-03T16:56:54.276ZTRACtest_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
101032026-03-03T16:56:54.277ZTRACtest_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101042026-03-03T16:56:54.277ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101052026-03-03T16:56:54.277ZDEBGtest_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101062026-03-03T16:56:54.277ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101072026-03-03T16:56:54.277ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101082026-03-03T16:56:54.277ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101092026-03-03T16:56:54.277ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101102026-03-03T16:56:54.277ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_uuid
101112026-03-03T16:56:54.277ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
101122026-03-03T16:56:54.277ZDEBGtest_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101132026-03-03T16:56:54.283ZDEBGtest_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 5b83d48c-0655-438b-87aa-fbaf0aadd439, lookup_type: ById(5b83d48c-0655-438b-87aa-fbaf0aadd439) }, key: 87b75148-24ab-4643-8655-087620cab27b, lookup_type: ByName("default") } result = Ok(())
101142026-03-03T16:56:54.283ZTRACtest_metrics (BackgroundTasks): successful lookup of siloed resource "InternetGateway" using built-in user background_task = vpc_route_manager
101152026-03-03T16:56:54.284ZDEBGtest_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:33115/vpc-routes
101162026-03-03T16:56:54.284ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101172026-03-03T16:56:54.285ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101182026-03-03T16:56:54.285ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101192026-03-03T16:56:54.285ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101202026-03-03T16:56:54.286ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101212026-03-03T16:56:54.287ZTRACtest_metrics (dropshot): incoming request local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47690 req_id = 0ac9067a-30ce-4849-a36d-73a6a9a37f8d sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
101222026-03-03T16:56:54.287ZDEBGtest_metrics (dropshot): determined request API version local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47690 req_id = 0ac9067a-30ce-4849-a36d-73a6a9a37f8d sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
101232026-03-03T16:56:54.287ZINFOtest_metrics (dropshot): request completed latency_us = 447 local_addr = [::1]:33115 method = PUT remote_addr = [::1]:47690 req_id = 0ac9067a-30ce-4849-a36d-73a6a9a37f8d response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
101242026-03-03T16:56:54.287ZDEBGtest_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:33115/vpc-routes", status: 204, headers: {"x-request-id": "0ac9067a-30ce-4849-a36d-73a6a9a37f8d", "date": "Tue, 03 Mar 2026 16:56:54 GMT"} })
101252026-03-03T16:56:54.287ZDEBGtest_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 287.600137ms iteration = 3 status = {}
101262026-03-03T16:56:54.288ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = measurements_histogramu64
101272026-03-03T16:56:54.288ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
101282026-03-03T16:56:54.288ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
101292026-03-03T16:56:54.288ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
101302026-03-03T16:56:54.289ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
101312026-03-03T16:56:54.289ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101322026-03-03T16:56:54.289ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101332026-03-03T16:56:54.289ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101342026-03-03T16:56:54.290ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
101352026-03-03T16:56:54.290ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
101362026-03-03T16:56:54.290ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101372026-03-03T16:56:54.290ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101382026-03-03T16:56:54.290ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101392026-03-03T16:56:54.290ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101402026-03-03T16:56:54.291ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101412026-03-03T16:56:54.292ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
101422026-03-03T16:56:54.292ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
101432026-03-03T16:56:54.292ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101442026-03-03T16:56:54.292ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101452026-03-03T16:56:54.292ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101462026-03-03T16:56:54.293ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101472026-03-03T16:56:54.294ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101482026-03-03T16:56:54.294ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101492026-03-03T16:56:54.294ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101502026-03-03T16:56:54.295ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101512026-03-03T16:56:54.296ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101522026-03-03T16:56:54.301ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101532026-03-03T16:56:54.301ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101542026-03-03T16:56:54.301ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101552026-03-03T16:56:54.301ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101562026-03-03T16:56:54.301ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101572026-03-03T16:56:54.301ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101582026-03-03T16:56:54.303ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101592026-03-03T16:56:54.303ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101602026-03-03T16:56:54.303ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101612026-03-03T16:56:54.304ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101622026-03-03T16:56:54.305ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101632026-03-03T16:56:54.307ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101642026-03-03T16:56:54.309ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '41c1c314-b812-4fb3-ab31-28abfa63ce10') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
101652026-03-03T16:56:54.311ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (11667673099072290478) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.225209098' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
101662026-03-03T16:56:54.313ZINFOtest_metrics (dropshot_external): request completed latency_us = 86950 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2079744-2e7f-4f91-bd06-8fe35dbce09e response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.225209098Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101672026-03-03T16:56:54.313ZINFOtest_metrics (external client test context): client received response status = 200
101682026-03-03T16:56:54.314ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101692026-03-03T16:56:54.314ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
101702026-03-03T16:56:54.314ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
101712026-03-03T16:56:54.314ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
101722026-03-03T16:56:54.314ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
101732026-03-03T16:56:54.314ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
101742026-03-03T16:56:54.314ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
101752026-03-03T16:56:54.314ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101762026-03-03T16:56:54.314ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10 version = 2026021900.0.0
101772026-03-03T16:56:54.314ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 19e5cf15-e329-477c-b36a-b121b036f2a5 uri = /913233fe-92a8-4635-9572-183f495429c4
101782026-03-03T16:56:54.314ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101792026-03-03T16:56:54.314ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
101802026-03-03T16:56:54.315ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
101812026-03-03T16:56:54.315ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
101822026-03-03T16:56:54.315ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
101832026-03-03T16:56:54.321ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7104 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 19e5cf15-e329-477c-b36a-b121b036f2a5 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
101842026-03-03T16:56:54.322ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
101852026-03-03T16:56:54.329ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
101862026-03-03T16:56:54.329ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
101872026-03-03T16:56:54.329ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
101882026-03-03T16:56:54.329ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
101892026-03-03T16:56:54.329ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
101902026-03-03T16:56:54.329ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
101912026-03-03T16:56:54.330ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
101922026-03-03T16:56:54.330ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
101932026-03-03T16:56:54.330ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
101942026-03-03T16:56:54.335ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
101952026-03-03T16:56:54.336ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
101962026-03-03T16:56:54.336ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
101972026-03-03T16:56:54.336ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
101982026-03-03T16:56:54.338ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 30 table_name = fields_string
101992026-03-03T16:56:54.338ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
102002026-03-03T16:56:54.338ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
102012026-03-03T16:56:54.338ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
102022026-03-03T16:56:54.338ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102032026-03-03T16:56:54.338ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102042026-03-03T16:56:54.339ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102052026-03-03T16:56:54.340ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
102062026-03-03T16:56:54.340ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102072026-03-03T16:56:54.340ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102082026-03-03T16:56:54.341ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102092026-03-03T16:56:54.341ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_u16
102102026-03-03T16:56:54.341ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
102112026-03-03T16:56:54.342ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
102122026-03-03T16:56:54.344ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
102132026-03-03T16:56:54.344ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102142026-03-03T16:56:54.344ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102152026-03-03T16:56:54.345ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102162026-03-03T16:56:54.345ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_uuid
102172026-03-03T16:56:54.345ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
102182026-03-03T16:56:54.345ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
102192026-03-03T16:56:54.345ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
102202026-03-03T16:56:54.346ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
102212026-03-03T16:56:54.346ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
102222026-03-03T16:56:54.346ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102232026-03-03T16:56:54.346ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102242026-03-03T16:56:54.347ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102252026-03-03T16:56:54.347ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = measurements_histogramu64
102262026-03-03T16:56:54.347ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
102272026-03-03T16:56:54.347ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
102282026-03-03T16:56:54.347ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
102292026-03-03T16:56:54.348ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
102302026-03-03T16:56:54.348ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
102312026-03-03T16:56:54.348ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102322026-03-03T16:56:54.349ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102332026-03-03T16:56:54.349ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102342026-03-03T16:56:54.349ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
102352026-03-03T16:56:54.349ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
102362026-03-03T16:56:54.350ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
102372026-03-03T16:56:54.352ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
102382026-03-03T16:56:54.352ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102392026-03-03T16:56:54.352ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102402026-03-03T16:56:54.352ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102412026-03-03T16:56:54.352ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102422026-03-03T16:56:54.352ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102432026-03-03T16:56:54.353ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102442026-03-03T16:56:54.354ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
102452026-03-03T16:56:54.354ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
102462026-03-03T16:56:54.354ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102472026-03-03T16:56:54.354ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102482026-03-03T16:56:54.354ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102492026-03-03T16:56:54.355ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102502026-03-03T16:56:54.357ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102512026-03-03T16:56:54.358ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102522026-03-03T16:56:54.358ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102532026-03-03T16:56:54.358ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102542026-03-03T16:56:54.359ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102552026-03-03T16:56:54.360ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102562026-03-03T16:56:54.360ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102572026-03-03T16:56:54.360ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102582026-03-03T16:56:54.361ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102592026-03-03T16:56:54.361ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102602026-03-03T16:56:54.361ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102612026-03-03T16:56:54.361ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102622026-03-03T16:56:54.362ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102632026-03-03T16:56:54.366ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102642026-03-03T16:56:54.366ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102652026-03-03T16:56:54.366ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102662026-03-03T16:56:54.366ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102672026-03-03T16:56:54.366ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102682026-03-03T16:56:54.366ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102692026-03-03T16:56:54.366ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102702026-03-03T16:56:54.366ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102712026-03-03T16:56:54.367ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102722026-03-03T16:56:54.372ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102732026-03-03T16:56:54.372ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102742026-03-03T16:56:54.372ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102752026-03-03T16:56:54.372ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102762026-03-03T16:56:54.372ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102772026-03-03T16:56:54.372ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102782026-03-03T16:56:54.375ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102792026-03-03T16:56:54.375ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102802026-03-03T16:56:54.375ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102812026-03-03T16:56:54.376ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102822026-03-03T16:56:54.377ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102832026-03-03T16:56:54.379ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102842026-03-03T16:56:54.381ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '41c1c314-b812-4fb3-ab31-28abfa63ce10') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
102852026-03-03T16:56:54.384ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (18411839779477951260) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.314069489' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
102862026-03-03T16:56:54.385ZINFOtest_metrics (dropshot_external): request completed latency_us = 71380 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 63aa399b-a1a6-48ba-90ad-fc634940194f response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.314069489Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
102872026-03-03T16:56:54.386ZINFOtest_metrics (external client test context): client received response status = 200
102882026-03-03T16:56:54.386ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
102892026-03-03T16:56:54.386ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
102902026-03-03T16:56:54.386ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
102912026-03-03T16:56:54.386ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
102922026-03-03T16:56:54.386ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
102932026-03-03T16:56:54.386ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
102942026-03-03T16:56:54.386ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
102952026-03-03T16:56:54.387ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
102962026-03-03T16:56:54.387ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1 version = 2026021900.0.0
102972026-03-03T16:56:54.387ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = c5976f23-cfd4-478f-a38b-b9f4888ed4ae uri = /913233fe-92a8-4635-9572-183f495429c4
102982026-03-03T16:56:54.387ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
102992026-03-03T16:56:54.387ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103002026-03-03T16:56:54.387ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103012026-03-03T16:56:54.387ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103022026-03-03T16:56:54.387ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103032026-03-03T16:56:54.394ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6863 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = c5976f23-cfd4-478f-a38b-b9f4888ed4ae response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
103042026-03-03T16:56:54.394ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
103052026-03-03T16:56:54.401ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
103062026-03-03T16:56:54.401ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
103072026-03-03T16:56:54.401ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
103082026-03-03T16:56:54.401ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
103092026-03-03T16:56:54.401ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
103102026-03-03T16:56:54.401ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
103112026-03-03T16:56:54.401ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
103122026-03-03T16:56:54.402ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
103132026-03-03T16:56:54.402ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
103142026-03-03T16:56:54.407ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
103152026-03-03T16:56:54.408ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103162026-03-03T16:56:54.408ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103172026-03-03T16:56:54.409ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103182026-03-03T16:56:54.409ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 30 table_name = fields_string
103192026-03-03T16:56:54.409ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
103202026-03-03T16:56:54.410ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
103212026-03-03T16:56:54.410ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
103222026-03-03T16:56:54.410ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103232026-03-03T16:56:54.410ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103242026-03-03T16:56:54.411ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103252026-03-03T16:56:54.411ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_u16
103262026-03-03T16:56:54.411ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
103272026-03-03T16:56:54.412ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103282026-03-03T16:56:54.412ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103292026-03-03T16:56:54.412ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103302026-03-03T16:56:54.412ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103312026-03-03T16:56:54.413ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_uuid
103322026-03-03T16:56:54.413ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
103332026-03-03T16:56:54.414ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
103342026-03-03T16:56:54.416ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
103352026-03-03T16:56:54.416ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103362026-03-03T16:56:54.416ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103372026-03-03T16:56:54.416ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103382026-03-03T16:56:54.417ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = measurements_histogramu64
103392026-03-03T16:56:54.417ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
103402026-03-03T16:56:54.417ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
103412026-03-03T16:56:54.417ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
103422026-03-03T16:56:54.418ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
103432026-03-03T16:56:54.419ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
103442026-03-03T16:56:54.419ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
103452026-03-03T16:56:54.419ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103462026-03-03T16:56:54.419ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103472026-03-03T16:56:54.419ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103482026-03-03T16:56:54.420ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
103492026-03-03T16:56:54.420ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
103502026-03-03T16:56:54.420ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103512026-03-03T16:56:54.420ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103522026-03-03T16:56:54.420ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103532026-03-03T16:56:54.421ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103542026-03-03T16:56:54.421ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
103552026-03-03T16:56:54.421ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
103562026-03-03T16:56:54.422ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
103572026-03-03T16:56:54.424ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
103582026-03-03T16:56:54.424ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103592026-03-03T16:56:54.424ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103602026-03-03T16:56:54.424ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103612026-03-03T16:56:54.424ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103622026-03-03T16:56:54.424ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103632026-03-03T16:56:54.424ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103642026-03-03T16:56:54.430ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103652026-03-03T16:56:54.430ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103662026-03-03T16:56:54.430ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103672026-03-03T16:56:54.431ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103682026-03-03T16:56:54.433ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103692026-03-03T16:56:54.435ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103702026-03-03T16:56:54.438ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103712026-03-03T16:56:54.438ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103722026-03-03T16:56:54.438ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103732026-03-03T16:56:54.438ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103742026-03-03T16:56:54.438ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103752026-03-03T16:56:54.438ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103762026-03-03T16:56:54.438ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103772026-03-03T16:56:54.438ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103782026-03-03T16:56:54.438ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103792026-03-03T16:56:54.438ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103802026-03-03T16:56:54.440ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103812026-03-03T16:56:54.442ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
103822026-03-03T16:56:54.446ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
103832026-03-03T16:56:54.446ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
103842026-03-03T16:56:54.465ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.386474024' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
103852026-03-03T16:56:54.471ZINFOtest_metrics (dropshot_external): request completed latency_us = 80476 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ad223252-da08-4451-a200-1d35e91529d4 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.386474024Z&order=descending&limit=1
103862026-03-03T16:56:54.471ZINFOtest_metrics (external client test context): client received response status = 200
103872026-03-03T16:56:54.471ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
103882026-03-03T16:56:54.471ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
103892026-03-03T16:56:54.471ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
103902026-03-03T16:56:54.471ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
103912026-03-03T16:56:54.471ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
103922026-03-03T16:56:54.471ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
103932026-03-03T16:56:54.471ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
103942026-03-03T16:56:54.471ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
103952026-03-03T16:56:54.471ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1 version = 2026021900.0.0
103962026-03-03T16:56:54.471ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 183414e6-275c-4c35-bcb6-f50a61f48c2b uri = /913233fe-92a8-4635-9572-183f495429c4
103972026-03-03T16:56:54.471ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
103982026-03-03T16:56:54.471ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
103992026-03-03T16:56:54.471ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104002026-03-03T16:56:54.471ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104012026-03-03T16:56:54.471ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104022026-03-03T16:56:54.476ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7409 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 183414e6-275c-4c35-bcb6-f50a61f48c2b response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
104032026-03-03T16:56:54.476ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
104042026-03-03T16:56:54.483ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
104052026-03-03T16:56:54.483ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
104062026-03-03T16:56:54.483ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
104072026-03-03T16:56:54.483ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
104082026-03-03T16:56:54.484ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
104092026-03-03T16:56:54.484ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
104102026-03-03T16:56:54.484ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
104112026-03-03T16:56:54.484ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
104122026-03-03T16:56:54.484ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
104132026-03-03T16:56:54.489ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
104142026-03-03T16:56:54.490ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104152026-03-03T16:56:54.490ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104162026-03-03T16:56:54.491ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104172026-03-03T16:56:54.492ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 30 table_name = fields_string
104182026-03-03T16:56:54.492ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
104192026-03-03T16:56:54.493ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
104202026-03-03T16:56:54.493ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
104212026-03-03T16:56:54.493ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104222026-03-03T16:56:54.493ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104232026-03-03T16:56:54.493ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104242026-03-03T16:56:54.494ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_u16
104252026-03-03T16:56:54.495ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
104262026-03-03T16:56:54.495ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104272026-03-03T16:56:54.495ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104282026-03-03T16:56:54.495ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104292026-03-03T16:56:54.495ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104302026-03-03T16:56:54.496ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_uuid
104312026-03-03T16:56:54.497ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
104322026-03-03T16:56:54.497ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
104332026-03-03T16:56:54.499ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
104342026-03-03T16:56:54.499ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104352026-03-03T16:56:54.499ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104362026-03-03T16:56:54.499ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104372026-03-03T16:56:54.501ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
104382026-03-03T16:56:54.501ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
104392026-03-03T16:56:54.501ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104402026-03-03T16:56:54.501ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104412026-03-03T16:56:54.501ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104422026-03-03T16:56:54.502ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = measurements_histogramu64
104432026-03-03T16:56:54.502ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
104442026-03-03T16:56:54.502ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
104452026-03-03T16:56:54.502ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
104462026-03-03T16:56:54.502ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
104472026-03-03T16:56:54.504ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104482026-03-03T16:56:54.504ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104492026-03-03T16:56:54.504ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104502026-03-03T16:56:54.504ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104512026-03-03T16:56:54.504ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
104522026-03-03T16:56:54.507ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
104532026-03-03T16:56:54.507ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104542026-03-03T16:56:54.507ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104552026-03-03T16:56:54.507ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104562026-03-03T16:56:54.507ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104572026-03-03T16:56:54.507ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104582026-03-03T16:56:54.507ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104592026-03-03T16:56:54.508ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
104602026-03-03T16:56:54.508ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
104612026-03-03T16:56:54.509ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104622026-03-03T16:56:54.509ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104632026-03-03T16:56:54.509ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104642026-03-03T16:56:54.509ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104652026-03-03T16:56:54.510ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
104662026-03-03T16:56:54.510ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
104672026-03-03T16:56:54.510ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
104682026-03-03T16:56:54.511ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104692026-03-03T16:56:54.513ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104702026-03-03T16:56:54.513ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104712026-03-03T16:56:54.513ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104722026-03-03T16:56:54.513ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104732026-03-03T16:56:54.513ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104742026-03-03T16:56:54.513ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104752026-03-03T16:56:54.514ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104762026-03-03T16:56:54.514ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104772026-03-03T16:56:54.514ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104782026-03-03T16:56:54.515ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104792026-03-03T16:56:54.521ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104802026-03-03T16:56:54.523ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104812026-03-03T16:56:54.524ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
104822026-03-03T16:56:54.527ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.468030374' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
104832026-03-03T16:56:54.531ZINFOtest_metrics (dropshot_external): request completed latency_us = 62945 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ee1fb6eb-d4e1-4bea-bcb2-d115bc566fa1 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.468030374Z&order=descending&limit=1
104842026-03-03T16:56:54.531ZINFOtest_metrics (external client test context): client received response status = 200
104852026-03-03T16:56:54.532ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
104862026-03-03T16:56:54.532ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
104872026-03-03T16:56:54.532ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
104882026-03-03T16:56:54.532ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
104892026-03-03T16:56:54.532ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
104902026-03-03T16:56:54.532ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
104912026-03-03T16:56:54.532ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
104922026-03-03T16:56:54.532ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
104932026-03-03T16:56:54.532ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1 version = 2026021900.0.0
104942026-03-03T16:56:54.532ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 9e272b5f-9949-4ba0-b9ca-c138830e972e uri = /913233fe-92a8-4635-9572-183f495429c4
104952026-03-03T16:56:54.532ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
104962026-03-03T16:56:54.532ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
104972026-03-03T16:56:54.532ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104982026-03-03T16:56:54.532ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104992026-03-03T16:56:54.533ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105002026-03-03T16:56:54.540ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 8148 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 9e272b5f-9949-4ba0-b9ca-c138830e972e response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
105012026-03-03T16:56:54.542ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
105022026-03-03T16:56:54.551ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
105032026-03-03T16:56:54.552ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
105042026-03-03T16:56:54.552ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
105052026-03-03T16:56:54.552ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
105062026-03-03T16:56:54.552ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
105072026-03-03T16:56:54.552ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
105082026-03-03T16:56:54.552ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
105092026-03-03T16:56:54.552ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105102026-03-03T16:56:54.552ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
105112026-03-03T16:56:54.557ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
105122026-03-03T16:56:54.558ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
105132026-03-03T16:56:54.558ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105142026-03-03T16:56:54.558ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105152026-03-03T16:56:54.558ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105162026-03-03T16:56:54.559ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105172026-03-03T16:56:54.559ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105182026-03-03T16:56:54.560ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 30 table_name = fields_string
105192026-03-03T16:56:54.560ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
105202026-03-03T16:56:54.561ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
105212026-03-03T16:56:54.562ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
105222026-03-03T16:56:54.562ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105232026-03-03T16:56:54.562ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105242026-03-03T16:56:54.562ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105252026-03-03T16:56:54.563ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_u16
105262026-03-03T16:56:54.563ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
105272026-03-03T16:56:54.563ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
105282026-03-03T16:56:54.563ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105292026-03-03T16:56:54.563ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105302026-03-03T16:56:54.563ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105312026-03-03T16:56:54.565ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
105322026-03-03T16:56:54.567ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
105332026-03-03T16:56:54.569ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105342026-03-03T16:56:54.569ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105352026-03-03T16:56:54.569ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105362026-03-03T16:56:54.569ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_uuid
105372026-03-03T16:56:54.569ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
105382026-03-03T16:56:54.569ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
105392026-03-03T16:56:54.569ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
105402026-03-03T16:56:54.569ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105412026-03-03T16:56:54.569ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105422026-03-03T16:56:54.569ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105432026-03-03T16:56:54.571ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
105442026-03-03T16:56:54.574ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105452026-03-03T16:56:54.574ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105462026-03-03T16:56:54.574ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105472026-03-03T16:56:54.574ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
105482026-03-03T16:56:54.575ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
105492026-03-03T16:56:54.575ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105502026-03-03T16:56:54.575ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105512026-03-03T16:56:54.575ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105522026-03-03T16:56:54.575ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105532026-03-03T16:56:54.575ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105542026-03-03T16:56:54.575ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105552026-03-03T16:56:54.576ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = measurements_histogramu64
105562026-03-03T16:56:54.578ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105572026-03-03T16:56:54.578ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105582026-03-03T16:56:54.578ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
105592026-03-03T16:56:54.578ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
105602026-03-03T16:56:54.578ZINFOtest_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
105612026-03-03T16:56:54.578ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
105622026-03-03T16:56:54.578ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 11319224-cb22-43d2-89ca-5cc2829ebcfb uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
105632026-03-03T16:56:54.578ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 11319224-cb22-43d2-89ca-5cc2829ebcfb uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
105642026-03-03T16:56:54.578ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 11319224-cb22-43d2-89ca-5cc2829ebcfb resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
105652026-03-03T16:56:54.578ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 11319224-cb22-43d2-89ca-5cc2829ebcfb roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
105662026-03-03T16:56:54.578ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 11319224-cb22-43d2-89ca-5cc2829ebcfb resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
105672026-03-03T16:56:54.578ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105682026-03-03T16:56:54.578ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105692026-03-03T16:56:54.578ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105702026-03-03T16:56:54.579ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105712026-03-03T16:56:54.580ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105722026-03-03T16:56:54.582ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105732026-03-03T16:56:54.582ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105742026-03-03T16:56:54.582ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105752026-03-03T16:56:54.582ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105762026-03-03T16:56:54.582ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105772026-03-03T16:56:54.583ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105782026-03-03T16:56:54.583ZINFOtest_metrics (dropshot_internal): request completed latency_us = 5867 local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 11319224-cb22-43d2-89ca-5cc2829ebcfb response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
105792026-03-03T16:56:54.583ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
105802026-03-03T16:56:54.583ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
105812026-03-03T16:56:54.584ZDEBGtest_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
105822026-03-03T16:56:54.584ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "11319224-cb22-43d2-89ca-5cc2829ebcfb", "content-length": "405", "date": "Tue, 03 Mar 2026 16:56:54 GMT"} })
105832026-03-03T16:56:54.584ZDEBGtest_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
105842026-03-03T16:56:54.584ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
105852026-03-03T16:56:54.584ZTRACtest_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 6e4cc38b-e693-4384-9ddc-710cac8a62ca uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
105862026-03-03T16:56:54.584ZDEBGtest_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 6e4cc38b-e693-4384-9ddc-710cac8a62ca uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
105872026-03-03T16:56:54.585ZTRACtest_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 6e4cc38b-e693-4384-9ddc-710cac8a62ca resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
105882026-03-03T16:56:54.587ZDEBGtest_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 6e4cc38b-e693-4384-9ddc-710cac8a62ca roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
105892026-03-03T16:56:54.587ZDEBGtest_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 6e4cc38b-e693-4384-9ddc-710cac8a62ca resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
105902026-03-03T16:56:54.587ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105912026-03-03T16:56:54.587ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105922026-03-03T16:56:54.587ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105932026-03-03T16:56:54.587ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
105942026-03-03T16:56:54.587ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
105952026-03-03T16:56:54.587ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105962026-03-03T16:56:54.587ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
105972026-03-03T16:56:54.588ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
105982026-03-03T16:56:54.588ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
105992026-03-03T16:56:54.588ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
106002026-03-03T16:56:54.588ZINFOtest_metrics (dropshot_internal): request completed latency_us = 3847 local_addr = 127.0.0.1:46333 method = GET remote_addr = 127.0.0.1:45750 req_id = 6e4cc38b-e693-4384-9ddc-710cac8a62ca response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
106012026-03-03T16:56:54.588ZDEBGtest_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:46333/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e4cc38b-e693-4384-9ddc-710cac8a62ca", "content-length": "29", "date": "Tue, 03 Mar 2026 16:56:54 GMT"} })
106022026-03-03T16:56:54.589ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
106032026-03-03T16:56:54.589ZTRACtest_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
106042026-03-03T16:56:54.589ZINFOtest_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
106052026-03-03T16:56:54.589ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
106062026-03-03T16:56:54.591ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
106072026-03-03T16:56:54.592ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
106082026-03-03T16:56:54.596ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.532015285' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
106092026-03-03T16:56:54.599ZINFOtest_metrics (dropshot_external): request completed latency_us = 67139 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 7e0801e2-7c60-48a3-b6b2-0e34c16dbc78 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.532015285Z&order=descending&limit=1
106102026-03-03T16:56:54.599ZINFOtest_metrics (external client test context): client received response status = 200
106112026-03-03T16:56:54.600ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106122026-03-03T16:56:54.600ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
106132026-03-03T16:56:54.600ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
106142026-03-03T16:56:54.600ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
106152026-03-03T16:56:54.600ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
106162026-03-03T16:56:54.600ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
106172026-03-03T16:56:54.600ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
106182026-03-03T16:56:54.600ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106192026-03-03T16:56:54.600ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1 version = 2026021900.0.0
106202026-03-03T16:56:54.600ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = c959aa14-f98f-4d14-8ac7-1a344ec9f9c9 uri = /913233fe-92a8-4635-9572-183f495429c4
106212026-03-03T16:56:54.601ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106222026-03-03T16:56:54.601ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106232026-03-03T16:56:54.601ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106242026-03-03T16:56:54.601ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106252026-03-03T16:56:54.601ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106262026-03-03T16:56:54.607ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6897 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = c959aa14-f98f-4d14-8ac7-1a344ec9f9c9 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
106272026-03-03T16:56:54.608ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
106282026-03-03T16:56:54.615ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
106292026-03-03T16:56:54.615ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
106302026-03-03T16:56:54.615ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
106312026-03-03T16:56:54.615ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
106322026-03-03T16:56:54.615ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
106332026-03-03T16:56:54.615ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
106342026-03-03T16:56:54.615ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
106352026-03-03T16:56:54.615ZDEBGtest_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106362026-03-03T16:56:54.616ZDEBGtest_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
106372026-03-03T16:56:54.621ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
106382026-03-03T16:56:54.621ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106392026-03-03T16:56:54.621ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106402026-03-03T16:56:54.622ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106412026-03-03T16:56:54.624ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
106422026-03-03T16:56:54.626ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
106432026-03-03T16:56:54.626ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106442026-03-03T16:56:54.626ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106452026-03-03T16:56:54.626ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106462026-03-03T16:56:54.626ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 32 table_name = fields_string
106472026-03-03T16:56:54.626ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
106482026-03-03T16:56:54.626ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
106492026-03-03T16:56:54.626ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106502026-03-03T16:56:54.626ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106512026-03-03T16:56:54.626ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106522026-03-03T16:56:54.628ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
106532026-03-03T16:56:54.630ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
106542026-03-03T16:56:54.630ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106552026-03-03T16:56:54.630ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106562026-03-03T16:56:54.630ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106572026-03-03T16:56:54.631ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_u16
106582026-03-03T16:56:54.631ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
106592026-03-03T16:56:54.632ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
106602026-03-03T16:56:54.632ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
106612026-03-03T16:56:54.632ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106622026-03-03T16:56:54.632ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106632026-03-03T16:56:54.632ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106642026-03-03T16:56:54.634ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_uuid
106652026-03-03T16:56:54.634ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
106662026-03-03T16:56:54.634ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
106672026-03-03T16:56:54.634ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106682026-03-03T16:56:54.634ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106692026-03-03T16:56:54.634ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106702026-03-03T16:56:54.635ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
106712026-03-03T16:56:54.637ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
106722026-03-03T16:56:54.637ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106732026-03-03T16:56:54.637ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106742026-03-03T16:56:54.637ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106752026-03-03T16:56:54.637ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106762026-03-03T16:56:54.637ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106772026-03-03T16:56:54.637ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106782026-03-03T16:56:54.639ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = measurements_histogramu64
106792026-03-03T16:56:54.639ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
106802026-03-03T16:56:54.639ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106812026-03-03T16:56:54.642ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106822026-03-03T16:56:54.642ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106832026-03-03T16:56:54.642ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106842026-03-03T16:56:54.642ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106852026-03-03T16:56:54.642ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106862026-03-03T16:56:54.642ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106872026-03-03T16:56:54.643ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
106882026-03-03T16:56:54.643ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106892026-03-03T16:56:54.643ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106902026-03-03T16:56:54.643ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
106912026-03-03T16:56:54.644ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
106922026-03-03T16:56:54.646ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106932026-03-03T16:56:54.647ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
106942026-03-03T16:56:54.649ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
106952026-03-03T16:56:54.651ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
106962026-03-03T16:56:54.651ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
106972026-03-03T16:56:54.652ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
106982026-03-03T16:56:54.652ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106992026-03-03T16:56:54.652ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (12379067900625785140) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.600146454' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
107002026-03-03T16:56:54.659ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
107012026-03-03T16:56:54.659ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
107022026-03-03T16:56:54.659ZINFOtest_metrics (dropshot_external): request completed latency_us = 59133 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c62bde44-841b-4ba1-aaf3-d290ddcabf71 response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.600146454Z&order=descending&limit=1
107032026-03-03T16:56:54.660ZINFOtest_metrics (external client test context): client received response status = 200
107042026-03-03T16:56:54.660ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107052026-03-03T16:56:54.660ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
107062026-03-03T16:56:54.660ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
107072026-03-03T16:56:54.660ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
107082026-03-03T16:56:54.660ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107092026-03-03T16:56:54.660ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1 version = 2026021900.0.0
107102026-03-03T16:56:54.660ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 58d981d5-c2ef-4b18-af1f-eb9da78fb1c8 uri = /913233fe-92a8-4635-9572-183f495429c4
107112026-03-03T16:56:54.661ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107122026-03-03T16:56:54.661ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107132026-03-03T16:56:54.661ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107142026-03-03T16:56:54.661ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107152026-03-03T16:56:54.661ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107162026-03-03T16:56:54.667ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6737 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 58d981d5-c2ef-4b18-af1f-eb9da78fb1c8 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
107172026-03-03T16:56:54.668ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
107182026-03-03T16:56:54.675ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
107192026-03-03T16:56:54.675ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
107202026-03-03T16:56:54.675ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
107212026-03-03T16:56:54.675ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
107222026-03-03T16:56:54.675ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
107232026-03-03T16:56:54.680ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
107242026-03-03T16:56:54.681ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107252026-03-03T16:56:54.681ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107262026-03-03T16:56:54.682ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107272026-03-03T16:56:54.684ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 30 table_name = fields_string
107282026-03-03T16:56:54.684ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
107292026-03-03T16:56:54.684ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
107302026-03-03T16:56:54.684ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
107312026-03-03T16:56:54.684ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107322026-03-03T16:56:54.684ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107332026-03-03T16:56:54.684ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107342026-03-03T16:56:54.685ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_u16
107352026-03-03T16:56:54.685ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
107362026-03-03T16:56:54.685ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107372026-03-03T16:56:54.685ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107382026-03-03T16:56:54.685ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107392026-03-03T16:56:54.686ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107402026-03-03T16:56:54.687ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
107412026-03-03T16:56:54.689ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
107422026-03-03T16:56:54.689ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107432026-03-03T16:56:54.689ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107442026-03-03T16:56:54.690ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107452026-03-03T16:56:54.690ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_uuid
107462026-03-03T16:56:54.690ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
107472026-03-03T16:56:54.691ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
107482026-03-03T16:56:54.691ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
107492026-03-03T16:56:54.691ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107502026-03-03T16:56:54.691ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107512026-03-03T16:56:54.691ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107522026-03-03T16:56:54.693ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107532026-03-03T16:56:54.693ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107542026-03-03T16:56:54.693ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107552026-03-03T16:56:54.693ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107562026-03-03T16:56:54.693ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = measurements_histogramu64
107572026-03-03T16:56:54.693ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
107582026-03-03T16:56:54.694ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
107592026-03-03T16:56:54.696ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
107602026-03-03T16:56:54.698ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107612026-03-03T16:56:54.698ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107622026-03-03T16:56:54.698ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107632026-03-03T16:56:54.698ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107642026-03-03T16:56:54.698ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107652026-03-03T16:56:54.698ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107662026-03-03T16:56:54.698ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107672026-03-03T16:56:54.701ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107682026-03-03T16:56:54.701ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107692026-03-03T16:56:54.701ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107702026-03-03T16:56:54.701ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107712026-03-03T16:56:54.701ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107722026-03-03T16:56:54.701ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107732026-03-03T16:56:54.703ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107742026-03-03T16:56:54.706ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107752026-03-03T16:56:54.707ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
107762026-03-03T16:56:54.711ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (7763646387282271213) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.660326269' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
107772026-03-03T16:56:54.717ZINFOtest_metrics (dropshot_external): request completed latency_us = 56557 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c1b32f7d-361f-48d8-a847-028435014be7 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.660326269Z&order=descending&limit=1
107782026-03-03T16:56:54.717ZINFOtest_metrics (external client test context): client received response status = 200
107792026-03-03T16:56:54.717ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
107802026-03-03T16:56:54.718ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
107812026-03-03T16:56:54.718ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1 version = 2026021900.0.0
107822026-03-03T16:56:54.718ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
107832026-03-03T16:56:54.720ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
107842026-03-03T16:56:54.720ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107852026-03-03T16:56:54.720ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107862026-03-03T16:56:54.720ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107872026-03-03T16:56:54.721ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107882026-03-03T16:56:54.721ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107892026-03-03T16:56:54.721ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107902026-03-03T16:56:54.723ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
107912026-03-03T16:56:54.723ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
107922026-03-03T16:56:54.723ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107932026-03-03T16:56:54.723ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107942026-03-03T16:56:54.723ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107952026-03-03T16:56:54.724ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107962026-03-03T16:56:54.724ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107972026-03-03T16:56:54.724ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107982026-03-03T16:56:54.725ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107992026-03-03T16:56:54.726ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
108002026-03-03T16:56:54.728ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
108012026-03-03T16:56:54.730ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108022026-03-03T16:56:54.730ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108032026-03-03T16:56:54.730ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108042026-03-03T16:56:54.730ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
108052026-03-03T16:56:54.730ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
108062026-03-03T16:56:54.730ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108072026-03-03T16:56:54.730ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108082026-03-03T16:56:54.731ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108092026-03-03T16:56:54.735ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
108102026-03-03T16:56:54.735ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108112026-03-03T16:56:54.735ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108122026-03-03T16:56:54.735ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108132026-03-03T16:56:54.735ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
108142026-03-03T16:56:54.736ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
108152026-03-03T16:56:54.736ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108162026-03-03T16:56:54.736ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108172026-03-03T16:56:54.736ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108182026-03-03T16:56:54.736ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108192026-03-03T16:56:54.736ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108202026-03-03T16:56:54.736ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108212026-03-03T16:56:54.738ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108222026-03-03T16:56:54.741ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108232026-03-03T16:56:54.741ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108242026-03-03T16:56:54.741ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108252026-03-03T16:56:54.741ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108262026-03-03T16:56:54.741ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108272026-03-03T16:56:54.741ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108282026-03-03T16:56:54.743ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108292026-03-03T16:56:54.745ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108302026-03-03T16:56:54.747ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
108312026-03-03T16:56:54.751ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10733361587332781639) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.717909870' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
108322026-03-03T16:56:54.754ZINFOtest_metrics (dropshot_external): request completed latency_us = 36333 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = d2a85d51-f6b6-45fc-9642-de3523434884 response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.717909870Z&order=descending&limit=1
108332026-03-03T16:56:54.754ZINFOtest_metrics (external client test context): client received response status = 200
108342026-03-03T16:56:54.755ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108352026-03-03T16:56:54.755ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108362026-03-03T16:56:54.755ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
108372026-03-03T16:56:54.755ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108382026-03-03T16:56:54.755ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108392026-03-03T16:56:54.755ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108402026-03-03T16:56:54.755ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108412026-03-03T16:56:54.756ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108422026-03-03T16:56:54.757ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108432026-03-03T16:56:54.758ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108442026-03-03T16:56:54.758ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108452026-03-03T16:56:54.759ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
108462026-03-03T16:56:54.759ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108472026-03-03T16:56:54.759ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108482026-03-03T16:56:54.759ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108492026-03-03T16:56:54.759ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108502026-03-03T16:56:54.759ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108512026-03-03T16:56:54.759ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108522026-03-03T16:56:54.759ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108532026-03-03T16:56:54.759ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108542026-03-03T16:56:54.760ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
108552026-03-03T16:56:54.760ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
108562026-03-03T16:56:54.760ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108572026-03-03T16:56:54.760ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108582026-03-03T16:56:54.760ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108592026-03-03T16:56:54.762ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108602026-03-03T16:56:54.767ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108612026-03-03T16:56:54.767ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108622026-03-03T16:56:54.767ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
108632026-03-03T16:56:54.767ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108642026-03-03T16:56:54.767ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
108652026-03-03T16:56:54.767ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
108662026-03-03T16:56:54.767ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
108672026-03-03T16:56:54.767ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108682026-03-03T16:56:54.767ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108692026-03-03T16:56:54.767ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108702026-03-03T16:56:54.769ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
108712026-03-03T16:56:54.771ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
108722026-03-03T16:56:54.773ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108732026-03-03T16:56:54.773ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108742026-03-03T16:56:54.773ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108752026-03-03T16:56:54.773ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
108762026-03-03T16:56:54.773ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
108772026-03-03T16:56:54.773ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
108782026-03-03T16:56:54.773ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
108792026-03-03T16:56:54.773ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108802026-03-03T16:56:54.773ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108812026-03-03T16:56:54.774ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108822026-03-03T16:56:54.775ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
108832026-03-03T16:56:54.777ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
108842026-03-03T16:56:54.777ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
108852026-03-03T16:56:54.777ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
108862026-03-03T16:56:54.777ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
108872026-03-03T16:56:54.779ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
108882026-03-03T16:56:54.779ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108892026-03-03T16:56:54.779ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108902026-03-03T16:56:54.779ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108912026-03-03T16:56:54.779ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108922026-03-03T16:56:54.779ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108932026-03-03T16:56:54.780ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108942026-03-03T16:56:54.781ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
108952026-03-03T16:56:54.781ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
108962026-03-03T16:56:54.782ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108972026-03-03T16:56:54.785ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108982026-03-03T16:56:54.785ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
108992026-03-03T16:56:54.785ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109002026-03-03T16:56:54.786ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109012026-03-03T16:56:54.787ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109022026-03-03T16:56:54.787ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109032026-03-03T16:56:54.787ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109042026-03-03T16:56:54.787ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109052026-03-03T16:56:54.787ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109062026-03-03T16:56:54.789ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109072026-03-03T16:56:54.789ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109082026-03-03T16:56:54.789ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109092026-03-03T16:56:54.789ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109102026-03-03T16:56:54.791ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109112026-03-03T16:56:54.793ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109122026-03-03T16:56:54.793ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109132026-03-03T16:56:54.794ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109142026-03-03T16:56:54.796ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109152026-03-03T16:56:54.796ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109162026-03-03T16:56:54.796ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109172026-03-03T16:56:54.796ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109182026-03-03T16:56:54.798ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109192026-03-03T16:56:54.799ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
109202026-03-03T16:56:54.802ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.754943369' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
109212026-03-03T16:56:54.806ZINFOtest_metrics (dropshot_external): request completed latency_us = 51160 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = a93a930a-d1a0-4e45-adf7-fb3c0f15b6c3 response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.754943369Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109222026-03-03T16:56:54.806ZINFOtest_metrics (external client test context): client received response status = 200
109232026-03-03T16:56:54.806ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109242026-03-03T16:56:54.807ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109252026-03-03T16:56:54.807ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
109262026-03-03T16:56:54.807ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109272026-03-03T16:56:54.808ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109282026-03-03T16:56:54.808ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109292026-03-03T16:56:54.808ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109302026-03-03T16:56:54.809ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109312026-03-03T16:56:54.809ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109322026-03-03T16:56:54.809ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109332026-03-03T16:56:54.809ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109342026-03-03T16:56:54.811ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
109352026-03-03T16:56:54.813ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
109362026-03-03T16:56:54.813ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109372026-03-03T16:56:54.813ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109382026-03-03T16:56:54.813ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109392026-03-03T16:56:54.813ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
109402026-03-03T16:56:54.813ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109412026-03-03T16:56:54.813ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109422026-03-03T16:56:54.813ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109432026-03-03T16:56:54.814ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
109442026-03-03T16:56:54.816ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
109452026-03-03T16:56:54.819ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109462026-03-03T16:56:54.819ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109472026-03-03T16:56:54.819ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109482026-03-03T16:56:54.819ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
109492026-03-03T16:56:54.819ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
109502026-03-03T16:56:54.819ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109512026-03-03T16:56:54.819ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109522026-03-03T16:56:54.819ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109532026-03-03T16:56:54.819ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
109542026-03-03T16:56:54.819ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109552026-03-03T16:56:54.819ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109562026-03-03T16:56:54.820ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
109572026-03-03T16:56:54.821ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
109582026-03-03T16:56:54.823ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
109592026-03-03T16:56:54.823ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109602026-03-03T16:56:54.823ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109612026-03-03T16:56:54.823ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109622026-03-03T16:56:54.823ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109632026-03-03T16:56:54.823ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109642026-03-03T16:56:54.823ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109652026-03-03T16:56:54.825ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109662026-03-03T16:56:54.832ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109672026-03-03T16:56:54.832ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109682026-03-03T16:56:54.832ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109692026-03-03T16:56:54.832ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109702026-03-03T16:56:54.833ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109712026-03-03T16:56:54.833ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109722026-03-03T16:56:54.833ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109732026-03-03T16:56:54.833ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109742026-03-03T16:56:54.833ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109752026-03-03T16:56:54.835ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109762026-03-03T16:56:54.835ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109772026-03-03T16:56:54.835ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109782026-03-03T16:56:54.835ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109792026-03-03T16:56:54.838ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109802026-03-03T16:56:54.839ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109812026-03-03T16:56:54.839ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109822026-03-03T16:56:54.839ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109832026-03-03T16:56:54.839ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109842026-03-03T16:56:54.839ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109852026-03-03T16:56:54.839ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109862026-03-03T16:56:54.841ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109872026-03-03T16:56:54.844ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109882026-03-03T16:56:54.845ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
109892026-03-03T16:56:54.849ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.806821662' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
109902026-03-03T16:56:54.850ZINFOtest_metrics (dropshot_external): request completed latency_us = 43269 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 88a76722-3803-4f22-b427-edd23795e411 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.806821662Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109912026-03-03T16:56:54.852ZINFOtest_metrics (external client test context): client received response status = 200
109922026-03-03T16:56:54.852ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109932026-03-03T16:56:54.852ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109942026-03-03T16:56:54.852ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
109952026-03-03T16:56:54.852ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109962026-03-03T16:56:54.852ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
109972026-03-03T16:56:54.852ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
109982026-03-03T16:56:54.852ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
109992026-03-03T16:56:54.852ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110002026-03-03T16:56:54.853ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110012026-03-03T16:56:54.854ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110022026-03-03T16:56:54.854ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110032026-03-03T16:56:54.855ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
110042026-03-03T16:56:54.856ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
110052026-03-03T16:56:54.856ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110062026-03-03T16:56:54.856ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110072026-03-03T16:56:54.856ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110082026-03-03T16:56:54.857ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
110092026-03-03T16:56:54.857ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110102026-03-03T16:56:54.857ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110112026-03-03T16:56:54.857ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110122026-03-03T16:56:54.859ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
110132026-03-03T16:56:54.861ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
110142026-03-03T16:56:54.861ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110152026-03-03T16:56:54.861ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110162026-03-03T16:56:54.861ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110172026-03-03T16:56:54.862ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
110182026-03-03T16:56:54.862ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
110192026-03-03T16:56:54.862ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110202026-03-03T16:56:54.862ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110212026-03-03T16:56:54.862ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110222026-03-03T16:56:54.862ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110232026-03-03T16:56:54.862ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110242026-03-03T16:56:54.862ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110252026-03-03T16:56:54.862ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110262026-03-03T16:56:54.862ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110272026-03-03T16:56:54.862ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110282026-03-03T16:56:54.862ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = e2dc4508-dbbc-4f57-bf64-804b980984ce uri = /913233fe-92a8-4635-9572-183f495429c4
110292026-03-03T16:56:54.868ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5258 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = e2dc4508-dbbc-4f57-bf64-804b980984ce response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
110302026-03-03T16:56:54.868ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
110312026-03-03T16:56:54.868ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
110322026-03-03T16:56:54.868ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110332026-03-03T16:56:54.868ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110342026-03-03T16:56:54.868ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110352026-03-03T16:56:54.869ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110362026-03-03T16:56:54.877ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110372026-03-03T16:56:54.877ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110382026-03-03T16:56:54.877ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
110392026-03-03T16:56:54.877ZDEBGtest_metrics (results-sink): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
110402026-03-03T16:56:54.877ZDEBGtest_metrics (clickhouse-client): unrolling 15 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
110412026-03-03T16:56:54.882ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 30 sql = INSERT INTO oximeter.fields_string FORMAT Native
110422026-03-03T16:56:54.883ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
110432026-03-03T16:56:54.883ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110442026-03-03T16:56:54.883ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110452026-03-03T16:56:54.884ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110462026-03-03T16:56:54.884ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 30 table_name = fields_string
110472026-03-03T16:56:54.884ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
110482026-03-03T16:56:54.885ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
110492026-03-03T16:56:54.887ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
110502026-03-03T16:56:54.888ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110512026-03-03T16:56:54.888ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110522026-03-03T16:56:54.888ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110532026-03-03T16:56:54.888ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110542026-03-03T16:56:54.888ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110552026-03-03T16:56:54.888ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110562026-03-03T16:56:54.888ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_u16
110572026-03-03T16:56:54.888ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 15 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
110582026-03-03T16:56:54.890ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = fields_uuid
110592026-03-03T16:56:54.890ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 15 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
110602026-03-03T16:56:54.890ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110612026-03-03T16:56:54.893ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110622026-03-03T16:56:54.894ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110632026-03-03T16:56:54.894ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110642026-03-03T16:56:54.894ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110652026-03-03T16:56:54.894ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 15 table_name = measurements_histogramu64
110662026-03-03T16:56:54.894ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
110672026-03-03T16:56:54.895ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110682026-03-03T16:56:54.896ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110692026-03-03T16:56:54.896ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110702026-03-03T16:56:54.896ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110712026-03-03T16:56:54.896ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110722026-03-03T16:56:54.897ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110732026-03-03T16:56:54.899ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110742026-03-03T16:56:54.899ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110752026-03-03T16:56:54.899ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110762026-03-03T16:56:54.900ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110772026-03-03T16:56:54.901ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110782026-03-03T16:56:54.902ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110792026-03-03T16:56:54.902ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110802026-03-03T16:56:54.902ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110812026-03-03T16:56:54.902ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110822026-03-03T16:56:54.902ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110832026-03-03T16:56:54.903ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110842026-03-03T16:56:54.906ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110852026-03-03T16:56:54.908ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
110862026-03-03T16:56:54.910ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:54.850790242' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
110872026-03-03T16:56:54.914ZINFOtest_metrics (dropshot_external): request completed latency_us = 63347 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 180e3ba8-0b57-4527-be8a-1d21069d5bc1 response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:54.850790242Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
110882026-03-03T16:56:54.914ZINFOtest_metrics (external client test context): client received response status = 200
110892026-03-03T16:56:54.915ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:40151/v1/disks?project=p-1
110902026-03-03T16:56:54.915ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed uri = /v1/disks?project=p-1
110912026-03-03T16:56:54.915ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed uri = /v1/disks?project=p-1 version = 2026021900.0.0
110922026-03-03T16:56:54.915ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed uri = /v1/disks?project=p-1
110932026-03-03T16:56:54.915ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/disks?project=p-1
110942026-03-03T16:56:54.915ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110952026-03-03T16:56:54.915ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110962026-03-03T16:56:54.916ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
110972026-03-03T16:56:54.917ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
110982026-03-03T16:56:54.919ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
110992026-03-03T16:56:54.919ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111002026-03-03T16:56:54.919ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
111012026-03-03T16:56:54.919ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
111022026-03-03T16:56:54.919ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111032026-03-03T16:56:54.919ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111042026-03-03T16:56:54.920ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111052026-03-03T16:56:54.921ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
111062026-03-03T16:56:54.922ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111072026-03-03T16:56:54.922ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111082026-03-03T16:56:54.922ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111092026-03-03T16:56:54.922ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
111102026-03-03T16:56:54.925ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
111112026-03-03T16:56:54.925ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111122026-03-03T16:56:54.925ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111132026-03-03T16:56:54.925ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111142026-03-03T16:56:54.927ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
111152026-03-03T16:56:54.927ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
111162026-03-03T16:56:54.927ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111172026-03-03T16:56:54.927ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111182026-03-03T16:56:54.927ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111192026-03-03T16:56:54.928ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
111202026-03-03T16:56:54.928ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
111212026-03-03T16:56:54.928ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
111222026-03-03T16:56:54.928ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
111232026-03-03T16:56:54.929ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
111242026-03-03T16:56:54.931ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
111252026-03-03T16:56:54.931ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed uri = /v1/disks?project=p-1
111262026-03-03T16:56:54.931ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111272026-03-03T16:56:54.931ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111282026-03-03T16:56:54.931ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111292026-03-03T16:56:54.931ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111302026-03-03T16:56:54.932ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111312026-03-03T16:56:54.933ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111322026-03-03T16:56:54.935ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111332026-03-03T16:56:54.935ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111342026-03-03T16:56:54.935ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111352026-03-03T16:56:54.935ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111362026-03-03T16:56:54.937ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111372026-03-03T16:56:54.938ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111382026-03-03T16:56:54.938ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111392026-03-03T16:56:54.939ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111402026-03-03T16:56:54.939ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111412026-03-03T16:56:54.939ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111422026-03-03T16:56:54.940ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111432026-03-03T16:56:54.940ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111442026-03-03T16:56:54.940ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111452026-03-03T16:56:54.940ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111462026-03-03T16:56:54.941ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111472026-03-03T16:56:54.942ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111482026-03-03T16:56:54.942ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111492026-03-03T16:56:54.942ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111502026-03-03T16:56:54.943ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111512026-03-03T16:56:54.944ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111522026-03-03T16:56:54.944ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111532026-03-03T16:56:54.945ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111542026-03-03T16:56:54.945ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111552026-03-03T16:56:54.946ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111562026-03-03T16:56:54.951ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ByName("p-1") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
111572026-03-03T16:56:54.951ZINFOtest_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
111582026-03-03T16:56:54.952ZINFOtest_metrics (SagaExecutor): preparing saga saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create
111592026-03-03T16:56:54.952ZINFOtest_metrics (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.create_crucible_disk_record","label":"CreateCrucibleDiskRecord","name":"crucible_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"created_disk"}},{"Start":{"params":{"create_params":{"description":"sells rainsticks","disk_backend":{"disk_source":{"block_size":512,"type":"blank"},"type":"distributed"},"name":"d-1","size":1073741824},"project_id":"41c1c314-b812-4fb3-ab31-28abfa63ce10","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
111602026-03-03T16:56:54.952ZINFOtest_metrics (SecStore): creating saga saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create
111612026-03-03T16:56:54.954ZINFOtest_metrics (SagaExecutor): starting saga saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create
111622026-03-03T16:56:54.954ZINFOtest_metrics (SEC): saga start saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
111632026-03-03T16:56:54.954ZDEBGtest_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
111642026-03-03T16:56:54.954ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
111652026-03-03T16:56:54.956ZDEBGtest_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
111662026-03-03T16:56:54.956ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
111672026-03-03T16:56:54.957ZDEBGtest_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
111682026-03-03T16:56:54.957ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
111692026-03-03T16:56:54.959ZDEBGtest_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
111702026-03-03T16:56:54.959ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("61f783c6-471f-4ed3-9bc9-1fde0040a81f")) node_id = 0 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
111712026-03-03T16:56:54.960ZDEBGtest_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
111722026-03-03T16:56:54.960ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
111732026-03-03T16:56:54.961ZDEBGtest_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
111742026-03-03T16:56:54.961ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")) node_id = 1 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
111752026-03-03T16:56:54.967ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
111762026-03-03T16:56:54.967ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
111772026-03-03T16:56:54.967ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
111782026-03-03T16:56:54.967ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
111792026-03-03T16:56:54.967ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
111802026-03-03T16:56:54.967ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
111812026-03-03T16:56:54.967ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
111822026-03-03T16:56:54.967ZDEBGtest_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
111832026-03-03T16:56:54.967ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
111842026-03-03T16:56:54.967ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
111852026-03-03T16:56:54.967ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
111862026-03-03T16:56:54.967ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
111872026-03-03T16:56:54.967ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
111882026-03-03T16:56:54.967ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
111892026-03-03T16:56:54.967ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
111902026-03-03T16:56:54.967ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
111912026-03-03T16:56:54.967ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = SpaceAccount silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
111922026-03-03T16:56:54.967ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = SpaceAccount silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
111932026-03-03T16:56:54.967ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = SpaceAccount silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
111942026-03-03T16:56:54.968ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
111952026-03-03T16:56:54.968ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
111962026-03-03T16:56:54.969ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
111972026-03-03T16:56:54.969ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
111982026-03-03T16:56:54.971ZDEBGtest_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
111992026-03-03T16:56:54.971ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112002026-03-03T16:56:54.973ZDEBGtest_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
112012026-03-03T16:56:54.973ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112022026-03-03T16:56:54.974ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112032026-03-03T16:56:54.974ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112042026-03-03T16:56:54.975ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112052026-03-03T16:56:54.976ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112062026-03-03T16:56:54.976ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112072026-03-03T16:56:54.976ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112082026-03-03T16:56:54.977ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112092026-03-03T16:56:54.977ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112102026-03-03T16:56:54.977ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112112026-03-03T16:56:54.977ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112122026-03-03T16:56:54.978ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112132026-03-03T16:56:54.980ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112142026-03-03T16:56:54.980ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112152026-03-03T16:56:54.980ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112162026-03-03T16:56:54.980ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112172026-03-03T16:56:54.982ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112182026-03-03T16:56:54.982ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112192026-03-03T16:56:54.982ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112202026-03-03T16:56:54.982ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112212026-03-03T16:56:54.984ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112222026-03-03T16:56:54.988ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112232026-03-03T16:56:54.988ZTRACtest_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112242026-03-03T16:56:54.988ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112252026-03-03T16:56:54.988ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112262026-03-03T16:56:54.988ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112272026-03-03T16:56:54.988ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112282026-03-03T16:56:54.990ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112292026-03-03T16:56:54.990ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112302026-03-03T16:56:54.990ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112312026-03-03T16:56:54.991ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112322026-03-03T16:56:54.992ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112332026-03-03T16:56:54.992ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112342026-03-03T16:56:54.992ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112352026-03-03T16:56:54.993ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112362026-03-03T16:56:54.994ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112372026-03-03T16:56:54.999ZDEBGtest_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112382026-03-03T16:56:54.999ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112392026-03-03T16:56:54.999ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112402026-03-03T16:56:54.999ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = CreateCrucibleDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112412026-03-03T16:56:55.050ZDEBGtest_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
112422026-03-03T16:56:55.051ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "name": String("d-1"), "time_created": String("2026-03-03T16:56:54.974539Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:54.974539Z")}, "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T16:56:54.974536948Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}}) node_id = 3 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112432026-03-03T16:56:55.053ZDEBGtest_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
112442026-03-03T16:56:55.053ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112452026-03-03T16:56:55.055ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = RegionsAlloc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112462026-03-03T16:56:55.055ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = RegionsAlloc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112472026-03-03T16:56:55.055ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = RegionsAlloc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112482026-03-03T16:56:55.063ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
112492026-03-03T16:56:55.063ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
112502026-03-03T16:56:55.116ZINFOtest_metrics (datastore): Allocated regions for volume datasets_and_regions = [(CrucibleDataset { identity: CrucibleDatasetIdentity { id: 60e7134a-828d-44bf-b3b9-fed9a76390f3 (dataset), time_created: 2026-03-03T16:56:47.655907Z, time_modified: 2026-03-03T16:56:47.655907Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 13c8ab22-383b-47f4-bd3f-b8715d874579 (zpool), ip: ::1, port: SqlU16(40043), size_used: 1342177280, no_provision: false }, Region { identity: RegionIdentity { id: da72af54-0c58-4301-825a-20c44caaa028, time_created: 2026-03-03T16:56:55.080615Z, time_modified: 2026-03-03T16:56:55.080615Z }, dataset_id: 60e7134a-828d-44bf-b3b9-fed9a76390f3 (dataset), volume_id: 2fa9b25b-2f64-4cf2-979f-9e14a548eb8b (volume), block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false, reservation_percent: TwentyFive }), (CrucibleDataset { identity: CrucibleDatasetIdentity { id: d3c33217-f619-4e69-b6d2-811716714c70 (dataset), time_created: 2026-03-03T16:56:48.055773Z, time_modified: 2026-03-03T16:56:48.055773Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: ddebdaea-c7a6-4a30-8bce-3ef11a4be74f (zpool), ip: ::1, port: SqlU16(42405), size_used: 1342177280, no_provision: false }, Region { identity: RegionIdentity { id: 206f6728-60c0-4f65-a444-d5db1697ba61, time_created: 2026-03-03T16:56:55.080615Z, time_modified: 2026-03-03T16:56:55.080615Z }, dataset_id: d3c33217-f619-4e69-b6d2-811716714c70 (dataset), volume_id: 2fa9b25b-2f64-4cf2-979f-9e14a548eb8b (volume), block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false, reservation_percent: TwentyFive }), (CrucibleDataset { identity: CrucibleDatasetIdentity { id: dc12e425-55fd-4e07-a830-103c3c369848 (dataset), time_created: 2026-03-03T16:56:47.179020Z, time_modified: 2026-03-03T16:56:47.179020Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: f9f58350-3473-4926-9fe3-e28dd584f1e9 (zpool), ip: ::1, port: SqlU16(40651), size_used: 1342177280, no_provision: false }, Region { identity: RegionIdentity { id: eb9cac61-6fe2-4c37-8b24-5fee7f4810d7, time_created: 2026-03-03T16:56:55.080615Z, time_modified: 2026-03-03T16:56:55.080615Z }, dataset_id: dc12e425-55fd-4e07-a830-103c3c369848 (dataset), volume_id: 2fa9b25b-2f64-4cf2-979f-9e14a548eb8b (volume), block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false, reservation_percent: TwentyFive })] maybe_snapshot_id = None volume_id = 2fa9b25b-2f64-4cf2-979f-9e14a548eb8b
112512026-03-03T16:56:55.118ZDEBGtest_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
112522026-03-03T16:56:55.118ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"identity": Object {"id": String("60e7134a-828d-44bf-b3b9-fed9a76390f3"), "time_created": String("2026-03-03T16:56:47.655907Z"), "time_modified": String("2026-03-03T16:56:47.655907Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("13c8ab22-383b-47f4-bd3f-b8715d874579"), "port": Number(40043), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("60e7134a-828d-44bf-b3b9-fed9a76390f3"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("da72af54-0c58-4301-825a-20c44caaa028"), "time_created": String("2026-03-03T16:56:55.080615Z"), "time_modified": String("2026-03-03T16:56:55.080615Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}], Array [Object {"identity": Object {"id": String("d3c33217-f619-4e69-b6d2-811716714c70"), "time_created": String("2026-03-03T16:56:48.055773Z"), "time_modified": String("2026-03-03T16:56:48.055773Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("ddebdaea-c7a6-4a30-8bce-3ef11a4be74f"), "port": Number(42405), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("d3c33217-f619-4e69-b6d2-811716714c70"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("206f6728-60c0-4f65-a444-d5db1697ba61"), "time_created": String("2026-03-03T16:56:55.080615Z"), "time_modified": String("2026-03-03T16:56:55.080615Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}], Array [Object {"identity": Object {"id": String("dc12e425-55fd-4e07-a830-103c3c369848"), "time_created": String("2026-03-03T16:56:47.179020Z"), "time_modified": String("2026-03-03T16:56:47.179020Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("f9f58350-3473-4926-9fe3-e28dd584f1e9"), "port": Number(40651), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("dc12e425-55fd-4e07-a830-103c3c369848"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("eb9cac61-6fe2-4c37-8b24-5fee7f4810d7"), "time_created": String("2026-03-03T16:56:55.080615Z"), "time_modified": String("2026-03-03T16:56:55.080615Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}]]) node_id = 4 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112532026-03-03T16:56:55.119ZDEBGtest_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
112542026-03-03T16:56:55.119ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112552026-03-03T16:56:55.120ZDEBGtest_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
112562026-03-03T16:56:55.121ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112572026-03-03T16:56:55.123ZDEBGtest_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
112582026-03-03T16:56:55.123ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112592026-03-03T16:56:55.129ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): accepted connection kind = storage local_addr = [::1]:42405 remote_addr = [::1]:58598 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
112602026-03-03T16:56:55.129ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): accepted connection kind = storage local_addr = [::1]:40651 remote_addr = [::1]:45860 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
112612026-03-03T16:56:55.154ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): accepted connection kind = storage local_addr = [::1]:40043 remote_addr = [::1]:43266 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
112622026-03-03T16:56:55.155ZTRACtest_metrics (Simulated CrucibleAgent Dropshot Server): incoming request kind = storage local_addr = [::1]:42405 method = POST remote_addr = [::1]:58598 req_id = 91abb50f-5763-4ea2-b504-2f9d8c9aa106 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
112632026-03-03T16:56:55.156ZTRACtest_metrics (Simulated CrucibleAgent Dropshot Server): incoming request kind = storage local_addr = [::1]:40651 method = POST remote_addr = [::1]:45860 req_id = 7346de35-f9bc-4141-91f0-ac6e4c4f0405 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
112642026-03-03T16:56:55.156ZTRACtest_metrics (Simulated CrucibleAgent Dropshot Server): incoming request kind = storage local_addr = [::1]:40043 method = POST remote_addr = [::1]:43266 req_id = defa85a3-612f-4a85-9fd4-baeacd517825 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
112652026-03-03T16:56:55.156ZINFOtest_metrics (SledAgent): created region 206f6728-60c0-4f65-a444-d5db1697ba61 end_port = 1150 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_port = 1100
112662026-03-03T16:56:55.156ZINFOtest_metrics (SledAgent): created region eb9cac61-6fe2-4c37-8b24-5fee7f4810d7 end_port = 1050 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_port = 1000
112672026-03-03T16:56:55.156ZINFOtest_metrics (SledAgent): created region da72af54-0c58-4301-825a-20c44caaa028 end_port = 1100 kind = storage server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_port = 1050
112682026-03-03T16:56:55.156ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): request completed kind = storage latency_us = 414 local_addr = [::1]:42405 method = POST remote_addr = [::1]:58598 req_id = 91abb50f-5763-4ea2-b504-2f9d8c9aa106 response_code = 200 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
112692026-03-03T16:56:55.156ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): request completed kind = storage latency_us = 371 local_addr = [::1]:40651 method = POST remote_addr = [::1]:45860 req_id = 7346de35-f9bc-4141-91f0-ac6e4c4f0405 response_code = 200 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
112702026-03-03T16:56:55.156ZINFOtest_metrics (Simulated CrucibleAgent Dropshot Server): request completed kind = storage latency_us = 354 local_addr = [::1]:40043 method = POST remote_addr = [::1]:43266 req_id = defa85a3-612f-4a85-9fd4-baeacd517825 response_code = 200 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/0/regions
112712026-03-03T16:56:55.160ZDEBGtest_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
112722026-03-03T16:56:55.161ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"block_size": Number(512), "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "read_only_parent": Null, "sub_volumes": Array [Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "extent_count": Number(16), "gen": Number(1), "opts": Object {"cert_pem": Null, "control": Null, "flush_timeout": Null, "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "key": String("Oz3x02b5lFQlfjJeZIQI3MdSysYQq4JxXt0b7EEbZFU="), "key_pem": Null, "lossy": Bool(false), "read_only": Bool(false), "root_cert_pem": Null, "target": Array [String("[::1]:1000"), String("[::1]:1050"), String("[::1]:1100")]}, "type": String("region")}], "type": String("volume")}) node_id = 6 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112732026-03-03T16:56:55.163ZDEBGtest_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
112742026-03-03T16:56:55.163ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112752026-03-03T16:56:55.165ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
112762026-03-03T16:56:55.165ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
112772026-03-03T16:56:55.171ZDEBGtest_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
112782026-03-03T16:56:55.171ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112792026-03-03T16:56:55.173ZDEBGtest_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
112802026-03-03T16:56:55.174ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
112812026-03-03T16:56:55.175ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112822026-03-03T16:56:55.175ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112832026-03-03T16:56:55.175ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112842026-03-03T16:56:55.177ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112852026-03-03T16:56:55.177ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112862026-03-03T16:56:55.178ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112872026-03-03T16:56:55.179ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112882026-03-03T16:56:55.179ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112892026-03-03T16:56:55.179ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112902026-03-03T16:56:55.180ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 61f783c6-471f-4ed3-9bc9-1fde0040a81f, lookup_type: ById(61f783c6-471f-4ed3-9bc9-1fde0040a81f) } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112912026-03-03T16:56:55.180ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112922026-03-03T16:56:55.180ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112932026-03-03T16:56:55.180ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112942026-03-03T16:56:55.181ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112952026-03-03T16:56:55.187ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112962026-03-03T16:56:55.187ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112972026-03-03T16:56:55.187ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112982026-03-03T16:56:55.188ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
112992026-03-03T16:56:55.190ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113002026-03-03T16:56:55.190ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113012026-03-03T16:56:55.190ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113022026-03-03T16:56:55.191ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113032026-03-03T16:56:55.192ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113042026-03-03T16:56:55.197ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 61f783c6-471f-4ed3-9bc9-1fde0040a81f, lookup_type: ById(61f783c6-471f-4ed3-9bc9-1fde0040a81f) } result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113052026-03-03T16:56:55.197ZTRACtest_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 61f783c6-471f-4ed3-9bc9-1fde0040a81f, lookup_type: ById(61f783c6-471f-4ed3-9bc9-1fde0040a81f) } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113062026-03-03T16:56:55.197ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113072026-03-03T16:56:55.197ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113082026-03-03T16:56:55.197ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113092026-03-03T16:56:55.198ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113102026-03-03T16:56:55.199ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113112026-03-03T16:56:55.200ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113122026-03-03T16:56:55.200ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113132026-03-03T16:56:55.200ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113142026-03-03T16:56:55.201ZTRACtest_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113152026-03-03T16:56:55.201ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113162026-03-03T16:56:55.202ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113172026-03-03T16:56:55.202ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113182026-03-03T16:56:55.204ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113192026-03-03T16:56:55.209ZDEBGtest_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) }, key: 61f783c6-471f-4ed3-9bc9-1fde0040a81f, lookup_type: ById(61f783c6-471f-4ed3-9bc9-1fde0040a81f) } result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113202026-03-03T16:56:55.209ZTRACtest_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113212026-03-03T16:56:55.209ZDEBGtest_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113222026-03-03T16:56:55.209ZDEBGtest_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_node = FinalizeDiskRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
113232026-03-03T16:56:55.212ZDEBGtest_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
113242026-03-03T16:56:55.212ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Object {"Crucible": Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "name": String("d-1"), "time_created": String("2026-03-03T16:56:54.974539Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:54.974539Z")}, "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T16:56:54.974536948Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}}}) node_id = 8 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
113252026-03-03T16:56:55.214ZDEBGtest_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
113262026-03-03T16:56:55.214ZDEBGtest_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
113272026-03-03T16:56:55.215ZDEBGtest_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
113282026-03-03T16:56:55.217ZDEBGtest_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
113292026-03-03T16:56:55.217ZINFOtest_metrics (SEC): update for saga cached state new_state = Done saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 sec_id = 913233fe-92a8-4635-9572-183f495429c4
113302026-03-03T16:56:55.217ZINFOtest_metrics (SecStore): updating state new_state = done saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
113312026-03-03T16:56:55.219ZINFOtest_metrics (SEC): saga finished result = success saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
113322026-03-03T16:56:55.221ZINFOtest_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749
113332026-03-03T16:56:55.221ZINFOtest_metrics (SagaExecutor): saga finished saga_id = fc62613b-e28e-4bb7-a2d8-6a871208a749 saga_name = disk-create saga_result = SagaResult { saga_id: fc62613b-e28e-4bb7-a2d8-6a871208a749, saga_log: SagaLog { saga_id: fc62613b-e28e-4bb7-a2d8-6a871208a749, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("61f783c6-471f-4ed3-9bc9-1fde0040a81f")), 1: Succeeded(String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")), 2: Succeeded(Null), 3: Succeeded(Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "name": String("d-1"), "time_created": String("2026-03-03T16:56:54.974539Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:54.974539Z")}, "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T16:56:54.974536948Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}}), 4: Succeeded(Array [Array [Object {"identity": Object {"id": String("60e7134a-828d-44bf-b3b9-fed9a76390f3"), "time_created": String("2026-03-03T16:56:47.655907Z"), "time_modified": String("2026-03-03T16:56:47.655907Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("13c8ab22-383b-47f4-bd3f-b8715d874579"), "port": Number(40043), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("60e7134a-828d-44bf-b3b9-fed9a76390f3"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("da72af54-0c58-4301-825a-20c44caaa028"), "time_created": String("2026-03-03T16:56:55.080615Z"), "time_modified": String("2026-03-03T16:56:55.080615Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}], Array [Object {"identity": Object {"id": String("d3c33217-f619-4e69-b6d2-811716714c70"), "time_created": String("2026-03-03T16:56:48.055773Z"), "time_modified": String("2026-03-03T16:56:48.055773Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("ddebdaea-c7a6-4a30-8bce-3ef11a4be74f"), "port": Number(42405), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("d3c33217-f619-4e69-b6d2-811716714c70"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("206f6728-60c0-4f65-a444-d5db1697ba61"), "time_created": String("2026-03-03T16:56:55.080615Z"), "time_modified": String("2026-03-03T16:56:55.080615Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}], Array [Object {"identity": Object {"id": String("dc12e425-55fd-4e07-a830-103c3c369848"), "time_created": String("2026-03-03T16:56:47.179020Z"), "time_modified": String("2026-03-03T16:56:47.179020Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("f9f58350-3473-4926-9fe3-e28dd584f1e9"), "port": Number(40651), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("dc12e425-55fd-4e07-a830-103c3c369848"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("eb9cac61-6fe2-4c37-8b24-5fee7f4810d7"), "time_created": String("2026-03-03T16:56:55.080615Z"), "time_modified": String("2026-03-03T16:56:55.080615Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}]]), 5: Succeeded(Null), 6: Succeeded(Object {"block_size": Number(512), "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "read_only_parent": Null, "sub_volumes": Array [Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "extent_count": Number(16), "gen": Number(1), "opts": Object {"cert_pem": Null, "control": Null, "flush_timeout": Null, "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "key": String("Oz3x02b5lFQlfjJeZIQI3MdSysYQq4JxXt0b7EEbZFU="), "key_pem": Null, "lossy": Bool(false), "read_only": Bool(false), "root_cert_pem": Null, "target": Array [String("[::1]:1000"), String("[::1]:1050"), String("[::1]:1100")]}, "type": String("region")}], "type": String("volume")}), 7: Succeeded(Null), 8: Succeeded(Object {"Crucible": Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "name": String("d-1"), "time_created": String("2026-03-03T16:56:54.974539Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:54.974539Z")}, "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T16:56:54.974536948Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}}}), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Object {"Crucible": Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "name": String("d-1"), "time_created": String("2026-03-03T16:56:54.974539Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:54.974539Z")}, "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T16:56:54.974536948Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}}}, node_outputs: {"created_disk": Object {"Crucible": Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "name": String("d-1"), "time_created": String("2026-03-03T16:56:54.974539Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:54.974539Z")}, "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T16:56:54.974536948Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}}}, "created_volume": Null, "crucible_disk": Object {"disk": Object {"block_size": String("Traditional"), "disk_type": String("Crucible"), "identity": Object {"description": String("sells rainsticks"), "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "name": String("d-1"), "time_created": String("2026-03-03T16:56:54.974539Z"), "time_deleted": Null, "time_modified": String("2026-03-03T16:56:54.974539Z")}, "project_id": String("41c1c314-b812-4fb3-ab31-28abfa63ce10"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2026-03-03T16:56:54.974536948Z")}, "size": Number(1073741824), "slot": Null}, "disk_type_crucible": Object {"create_image_id": Null, "create_snapshot_id": Null, "disk_id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "pantry_address": Null, "read_only": Bool(false), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}}, "datasets_and_regions": Array [Array [Object {"identity": Object {"id": String("60e7134a-828d-44bf-b3b9-fed9a76390f3"), "time_created": String("2026-03-03T16:56:47.655907Z"), "time_modified": String("2026-03-03T16:56:47.655907Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("13c8ab22-383b-47f4-bd3f-b8715d874579"), "port": Number(40043), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("60e7134a-828d-44bf-b3b9-fed9a76390f3"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("da72af54-0c58-4301-825a-20c44caaa028"), "time_created": String("2026-03-03T16:56:55.080615Z"), "time_modified": String("2026-03-03T16:56:55.080615Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}], Array [Object {"identity": Object {"id": String("d3c33217-f619-4e69-b6d2-811716714c70"), "time_created": String("2026-03-03T16:56:48.055773Z"), "time_modified": String("2026-03-03T16:56:48.055773Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("ddebdaea-c7a6-4a30-8bce-3ef11a4be74f"), "port": Number(42405), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("d3c33217-f619-4e69-b6d2-811716714c70"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("206f6728-60c0-4f65-a444-d5db1697ba61"), "time_created": String("2026-03-03T16:56:55.080615Z"), "time_modified": String("2026-03-03T16:56:55.080615Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}], Array [Object {"identity": Object {"id": String("dc12e425-55fd-4e07-a830-103c3c369848"), "time_created": String("2026-03-03T16:56:47.179020Z"), "time_modified": String("2026-03-03T16:56:47.179020Z")}, "ip": String("::1"), "no_provision": Bool(false), "pool_id": String("f9f58350-3473-4926-9fe3-e28dd584f1e9"), "port": Number(40651), "rcgen": Number(1), "size_used": Number(1342177280), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("dc12e425-55fd-4e07-a830-103c3c369848"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("eb9cac61-6fe2-4c37-8b24-5fee7f4810d7"), "time_created": String("2026-03-03T16:56:55.080615Z"), "time_modified": String("2026-03-03T16:56:55.080615Z")}, "port": Null, "read_only": Bool(false), "reservation_percent": String("TwentyFive"), "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")}]], "disk_id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "no_result": Null, "regions_ensure": Object {"block_size": Number(512), "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "read_only_parent": Null, "sub_volumes": Array [Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "extent_count": Number(16), "gen": Number(1), "opts": Object {"cert_pem": Null, "control": Null, "flush_timeout": Null, "id": String("61f783c6-471f-4ed3-9bc9-1fde0040a81f"), "key": String("Oz3x02b5lFQlfjJeZIQI3MdSysYQq4JxXt0b7EEbZFU="), "key_pem": Null, "lossy": Bool(false), "read_only": Bool(false), "root_cert_pem": Null, "target": Array [String("[::1]:1000"), String("[::1]:1050"), String("[::1]:1100")]}, "type": String("region")}], "type": String("volume")}, "regions_ensure_undo": Null, "volume_id": String("2fa9b25b-2f64-4cf2-979f-9e14a548eb8b")} }) }
113342026-03-03T16:56:55.221ZTRACtest_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
113352026-03-03T16:56:55.221ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
113362026-03-03T16:56:55.221ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
113372026-03-03T16:56:55.221ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
113382026-03-03T16:56:55.221ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
113392026-03-03T16:56:55.222ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
113402026-03-03T16:56:55.224ZDEBGtest_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
113412026-03-03T16:56:55.224ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
113422026-03-03T16:56:55.224ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
113432026-03-03T16:56:55.224ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/disks?project=p-1
113442026-03-03T16:56:55.226ZINFOtest_metrics (dropshot_external): request completed latency_us = 311037 local_addr = 127.0.0.1:40151 method = POST remote_addr = 127.0.0.1:36496 req_id = 90dd8f86-a7b8-452c-b606-8b7ff7e1b7ed response_code = 201 uri = /v1/disks?project=p-1
113452026-03-03T16:56:55.227ZINFOtest_metrics (external client test context): client received response status = 201
113462026-03-03T16:56:55.227ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
113472026-03-03T16:56:55.227ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
113482026-03-03T16:56:55.227ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
113492026-03-03T16:56:55.227ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
113502026-03-03T16:56:55.227ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
113512026-03-03T16:56:55.227ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
113522026-03-03T16:56:55.227ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
113532026-03-03T16:56:55.227ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
113542026-03-03T16:56:55.227ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10 version = 2026021900.0.0
113552026-03-03T16:56:55.227ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 39354201-b7f8-42fb-8d44-0dc6a8541961 uri = /913233fe-92a8-4635-9572-183f495429c4
113562026-03-03T16:56:55.227ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
113572026-03-03T16:56:55.227ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
113582026-03-03T16:56:55.227ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113592026-03-03T16:56:55.227ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113602026-03-03T16:56:55.228ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113612026-03-03T16:56:55.234ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7210 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 39354201-b7f8-42fb-8d44-0dc6a8541961 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
113622026-03-03T16:56:55.235ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
113632026-03-03T16:56:55.243ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
113642026-03-03T16:56:55.244ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
113652026-03-03T16:56:55.244ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
113662026-03-03T16:56:55.244ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
113672026-03-03T16:56:55.244ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
113682026-03-03T16:56:55.244ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
113692026-03-03T16:56:55.244ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
113702026-03-03T16:56:55.244ZDEBGtest_metrics (results-sink): inserting 19 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
113712026-03-03T16:56:55.244ZDEBGtest_metrics (clickhouse-client): unrolling 19 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
113722026-03-03T16:56:55.250ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
113732026-03-03T16:56:55.251ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113742026-03-03T16:56:55.252ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113752026-03-03T16:56:55.252ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113762026-03-03T16:56:55.253ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 32 table_name = fields_string
113772026-03-03T16:56:55.253ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
113782026-03-03T16:56:55.253ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
113792026-03-03T16:56:55.253ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
113802026-03-03T16:56:55.253ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113812026-03-03T16:56:55.253ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113822026-03-03T16:56:55.254ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113832026-03-03T16:56:55.256ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
113842026-03-03T16:56:55.257ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113852026-03-03T16:56:55.257ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113862026-03-03T16:56:55.257ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113872026-03-03T16:56:55.257ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = fields_u16
113882026-03-03T16:56:55.257ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 19 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
113892026-03-03T16:56:55.257ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
113902026-03-03T16:56:55.259ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
113912026-03-03T16:56:55.259ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113922026-03-03T16:56:55.259ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
113932026-03-03T16:56:55.260ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
113942026-03-03T16:56:55.261ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 19 table_name = fields_uuid
113952026-03-03T16:56:55.261ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
113962026-03-03T16:56:55.261ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
113972026-03-03T16:56:55.261ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
113982026-03-03T16:56:55.261ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
113992026-03-03T16:56:55.261ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114002026-03-03T16:56:55.262ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114012026-03-03T16:56:55.264ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
114022026-03-03T16:56:55.264ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114032026-03-03T16:56:55.264ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114042026-03-03T16:56:55.264ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114052026-03-03T16:56:55.265ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
114062026-03-03T16:56:55.267ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
114072026-03-03T16:56:55.267ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114082026-03-03T16:56:55.267ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114092026-03-03T16:56:55.267ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114102026-03-03T16:56:55.267ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114112026-03-03T16:56:55.267ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114122026-03-03T16:56:55.267ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114132026-03-03T16:56:55.268ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = measurements_histogramu64
114142026-03-03T16:56:55.268ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 3 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
114152026-03-03T16:56:55.268ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
114162026-03-03T16:56:55.268ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
114172026-03-03T16:56:55.269ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 3 table_name = measurements_i64
114182026-03-03T16:56:55.269ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
114192026-03-03T16:56:55.269ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
114202026-03-03T16:56:55.269ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
114212026-03-03T16:56:55.270ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
114222026-03-03T16:56:55.271ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114232026-03-03T16:56:55.271ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114242026-03-03T16:56:55.271ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114252026-03-03T16:56:55.271ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114262026-03-03T16:56:55.272ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114272026-03-03T16:56:55.274ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114282026-03-03T16:56:55.274ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114292026-03-03T16:56:55.274ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114302026-03-03T16:56:55.275ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114312026-03-03T16:56:55.275ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
114322026-03-03T16:56:55.275ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
114332026-03-03T16:56:55.276ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114342026-03-03T16:56:55.276ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114352026-03-03T16:56:55.276ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114362026-03-03T16:56:55.277ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
114372026-03-03T16:56:55.277ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
114382026-03-03T16:56:55.277ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114392026-03-03T16:56:55.277ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114402026-03-03T16:56:55.277ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114412026-03-03T16:56:55.277ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114422026-03-03T16:56:55.278ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114432026-03-03T16:56:55.279ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114442026-03-03T16:56:55.279ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114452026-03-03T16:56:55.279ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114462026-03-03T16:56:55.280ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114472026-03-03T16:56:55.281ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114482026-03-03T16:56:55.282ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114492026-03-03T16:56:55.282ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114502026-03-03T16:56:55.282ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114512026-03-03T16:56:55.286ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114522026-03-03T16:56:55.289ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114532026-03-03T16:56:55.289ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114542026-03-03T16:56:55.289ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114552026-03-03T16:56:55.289ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114562026-03-03T16:56:55.289ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114572026-03-03T16:56:55.289ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114582026-03-03T16:56:55.292ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114592026-03-03T16:56:55.292ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114602026-03-03T16:56:55.292ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114612026-03-03T16:56:55.292ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114622026-03-03T16:56:55.294ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114632026-03-03T16:56:55.296ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114642026-03-03T16:56:55.298ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '41c1c314-b812-4fb3-ab31-28abfa63ce10') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
114652026-03-03T16:56:55.300ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (177066575428309413) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:55.226927109' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
114662026-03-03T16:56:55.304ZINFOtest_metrics (dropshot_external): request completed latency_us = 76720 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 9c751f33-15f8-4257-b660-28dc0cb64745 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.226927109Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114672026-03-03T16:56:55.304ZINFOtest_metrics (external client test context): client received response status = 200
114682026-03-03T16:56:55.304ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114692026-03-03T16:56:55.304ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
114702026-03-03T16:56:55.304ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
114712026-03-03T16:56:55.304ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
114722026-03-03T16:56:55.305ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114732026-03-03T16:56:55.305ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10 version = 2026021900.0.0
114742026-03-03T16:56:55.305ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 1eb54513-fb0c-4de0-a9a9-ac6272d34e3d uri = /913233fe-92a8-4635-9572-183f495429c4
114752026-03-03T16:56:55.305ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114762026-03-03T16:56:55.305ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
114772026-03-03T16:56:55.305ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114782026-03-03T16:56:55.305ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114792026-03-03T16:56:55.306ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114802026-03-03T16:56:55.312ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7023 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 1eb54513-fb0c-4de0-a9a9-ac6272d34e3d response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
114812026-03-03T16:56:55.312ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
114822026-03-03T16:56:55.320ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
114832026-03-03T16:56:55.320ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
114842026-03-03T16:56:55.320ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
114852026-03-03T16:56:55.320ZDEBGtest_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
114862026-03-03T16:56:55.320ZDEBGtest_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
114872026-03-03T16:56:55.326ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
114882026-03-03T16:56:55.328ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114892026-03-03T16:56:55.328ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114902026-03-03T16:56:55.329ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114912026-03-03T16:56:55.331ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 32 table_name = fields_string
114922026-03-03T16:56:55.331ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
114932026-03-03T16:56:55.331ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
114942026-03-03T16:56:55.331ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
114952026-03-03T16:56:55.331ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
114962026-03-03T16:56:55.331ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
114972026-03-03T16:56:55.332ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
114982026-03-03T16:56:55.333ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
114992026-03-03T16:56:55.334ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115002026-03-03T16:56:55.334ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115012026-03-03T16:56:55.334ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115022026-03-03T16:56:55.335ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
115032026-03-03T16:56:55.337ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
115042026-03-03T16:56:55.337ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115052026-03-03T16:56:55.337ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115062026-03-03T16:56:55.338ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115072026-03-03T16:56:55.339ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = fields_u16
115082026-03-03T16:56:55.339ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
115092026-03-03T16:56:55.339ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
115102026-03-03T16:56:55.339ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
115112026-03-03T16:56:55.339ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115122026-03-03T16:56:55.339ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115132026-03-03T16:56:55.340ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115142026-03-03T16:56:55.341ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
115152026-03-03T16:56:55.341ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115162026-03-03T16:56:55.341ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115172026-03-03T16:56:55.341ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
115182026-03-03T16:56:55.342ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = fields_uuid
115192026-03-03T16:56:55.342ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
115202026-03-03T16:56:55.342ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
115212026-03-03T16:56:55.344ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
115222026-03-03T16:56:55.345ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115232026-03-03T16:56:55.345ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115242026-03-03T16:56:55.345ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115252026-03-03T16:56:55.345ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115262026-03-03T16:56:55.345ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115272026-03-03T16:56:55.345ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115282026-03-03T16:56:55.347ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = measurements_histogramu64
115292026-03-03T16:56:55.347ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
115302026-03-03T16:56:55.347ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115312026-03-03T16:56:55.347ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115322026-03-03T16:56:55.347ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115332026-03-03T16:56:55.347ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115342026-03-03T16:56:55.349ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115352026-03-03T16:56:55.351ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115362026-03-03T16:56:55.351ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115372026-03-03T16:56:55.352ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115382026-03-03T16:56:55.352ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115392026-03-03T16:56:55.352ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115402026-03-03T16:56:55.353ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115412026-03-03T16:56:55.353ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115422026-03-03T16:56:55.355ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115432026-03-03T16:56:55.355ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115442026-03-03T16:56:55.355ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115452026-03-03T16:56:55.355ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115462026-03-03T16:56:55.355ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115472026-03-03T16:56:55.357ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115482026-03-03T16:56:55.357ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115492026-03-03T16:56:55.357ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115502026-03-03T16:56:55.357ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115512026-03-03T16:56:55.359ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115522026-03-03T16:56:55.359ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115532026-03-03T16:56:55.359ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115542026-03-03T16:56:55.360ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115552026-03-03T16:56:55.361ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115562026-03-03T16:56:55.366ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115572026-03-03T16:56:55.366ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115582026-03-03T16:56:55.366ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115592026-03-03T16:56:55.366ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115602026-03-03T16:56:55.366ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115612026-03-03T16:56:55.366ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115622026-03-03T16:56:55.368ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115632026-03-03T16:56:55.368ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115642026-03-03T16:56:55.368ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115652026-03-03T16:56:55.369ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115662026-03-03T16:56:55.369ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
115672026-03-03T16:56:55.369ZDEBGtest_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
115682026-03-03T16:56:55.369ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
115692026-03-03T16:56:55.369ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
115702026-03-03T16:56:55.369ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
115712026-03-03T16:56:55.371ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115722026-03-03T16:56:55.372ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115732026-03-03T16:56:55.374ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '41c1c314-b812-4fb3-ab31-28abfa63ce10') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
115742026-03-03T16:56:55.374ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
115752026-03-03T16:56:55.375ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
115762026-03-03T16:56:55.375ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
115772026-03-03T16:56:55.375ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
115782026-03-03T16:56:55.375ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
115792026-03-03T16:56:55.375ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
115802026-03-03T16:56:55.375ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
115812026-03-03T16:56:55.376ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (11667673099072290478) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:55.304743832' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
115822026-03-03T16:56:55.377ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
115832026-03-03T16:56:55.377ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
115842026-03-03T16:56:55.378ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
115852026-03-03T16:56:55.378ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
115862026-03-03T16:56:55.378ZINFOtest_metrics (dropshot_external): request completed latency_us = 73294 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 086e660d-77c7-40ce-ac45-1a62d6ddcea3 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.304743832Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115872026-03-03T16:56:55.378ZINFOtest_metrics (external client test context): client received response status = 200
115882026-03-03T16:56:55.379ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115892026-03-03T16:56:55.379ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
115902026-03-03T16:56:55.379ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
115912026-03-03T16:56:55.379ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
115922026-03-03T16:56:55.379ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115932026-03-03T16:56:55.379ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10 version = 2026021900.0.0
115942026-03-03T16:56:55.379ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 5f2dd9b5-dec7-48fc-883f-891faf492f77 uri = /913233fe-92a8-4635-9572-183f495429c4
115952026-03-03T16:56:55.379ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115962026-03-03T16:56:55.379ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
115972026-03-03T16:56:55.379ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
115982026-03-03T16:56:55.379ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
115992026-03-03T16:56:55.380ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
116002026-03-03T16:56:55.386ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6966 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 5f2dd9b5-dec7-48fc-883f-891faf492f77 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
116012026-03-03T16:56:55.387ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
116022026-03-03T16:56:55.394ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
116032026-03-03T16:56:55.394ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
116042026-03-03T16:56:55.394ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
116052026-03-03T16:56:55.394ZDEBGtest_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
116062026-03-03T16:56:55.395ZDEBGtest_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
116072026-03-03T16:56:55.400ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
116082026-03-03T16:56:55.401ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
116092026-03-03T16:56:55.401ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
116102026-03-03T16:56:55.402ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
116112026-03-03T16:56:55.403ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 32 table_name = fields_string
116122026-03-03T16:56:55.403ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
116132026-03-03T16:56:55.403ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
116142026-03-03T16:56:55.403ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
116152026-03-03T16:56:55.404ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
116162026-03-03T16:56:55.404ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
116172026-03-03T16:56:55.404ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
116182026-03-03T16:56:55.405ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = fields_u16
116192026-03-03T16:56:55.405ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
116202026-03-03T16:56:55.405ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
116212026-03-03T16:56:55.405ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
116222026-03-03T16:56:55.405ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
116232026-03-03T16:56:55.406ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
116242026-03-03T16:56:55.407ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = fields_uuid
116252026-03-03T16:56:55.407ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
116262026-03-03T16:56:55.407ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
116272026-03-03T16:56:55.410ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
116282026-03-03T16:56:55.410ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
116292026-03-03T16:56:55.410ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
116302026-03-03T16:56:55.410ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
116312026-03-03T16:56:55.411ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
116322026-03-03T16:56:55.414ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
116332026-03-03T16:56:55.414ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
116342026-03-03T16:56:55.414ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
116352026-03-03T16:56:55.414ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
116362026-03-03T16:56:55.414ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
116372026-03-03T16:56:55.414ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
116382026-03-03T16:56:55.414ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
116392026-03-03T16:56:55.414ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
116402026-03-03T16:56:55.414ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = measurements_histogramu64
116412026-03-03T16:56:55.414ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
116422026-03-03T16:56:55.414ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
116432026-03-03T16:56:55.417ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
116442026-03-03T16:56:55.417ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116452026-03-03T16:56:55.417ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116462026-03-03T16:56:55.417ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116472026-03-03T16:56:55.417ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116482026-03-03T16:56:55.417ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116492026-03-03T16:56:55.417ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116502026-03-03T16:56:55.419ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116512026-03-03T16:56:55.419ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116522026-03-03T16:56:55.419ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116532026-03-03T16:56:55.419ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116542026-03-03T16:56:55.421ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116552026-03-03T16:56:55.422ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116562026-03-03T16:56:55.422ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116572026-03-03T16:56:55.422ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116582026-03-03T16:56:55.423ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116592026-03-03T16:56:55.424ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116602026-03-03T16:56:55.424ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116612026-03-03T16:56:55.424ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116622026-03-03T16:56:55.425ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116632026-03-03T16:56:55.425ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource_id = 41c1c314-b812-4fb3-ab31-28abfa63ce10 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116642026-03-03T16:56:55.425ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116652026-03-03T16:56:55.425ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116662026-03-03T16:56:55.426ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116672026-03-03T16:56:55.427ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116682026-03-03T16:56:55.427ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116692026-03-03T16:56:55.427ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116702026-03-03T16:56:55.428ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116712026-03-03T16:56:55.429ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116722026-03-03T16:56:55.431ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116732026-03-03T16:56:55.431ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116742026-03-03T16:56:55.431ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116752026-03-03T16:56:55.431ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116762026-03-03T16:56:55.435ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 41c1c314-b812-4fb3-ab31-28abfa63ce10, lookup_type: ById(41c1c314-b812-4fb3-ab31-28abfa63ce10) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116772026-03-03T16:56:55.437ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116782026-03-03T16:56:55.437ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116792026-03-03T16:56:55.437ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116802026-03-03T16:56:55.437ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116812026-03-03T16:56:55.437ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116822026-03-03T16:56:55.437ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116832026-03-03T16:56:55.437ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116842026-03-03T16:56:55.437ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116852026-03-03T16:56:55.438ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116862026-03-03T16:56:55.439ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116872026-03-03T16:56:55.441ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116882026-03-03T16:56:55.443ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '41c1c314-b812-4fb3-ab31-28abfa63ce10') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
116892026-03-03T16:56:55.446ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (18411839779477951260) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:55.379042000' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
116902026-03-03T16:56:55.449ZINFOtest_metrics (dropshot_external): request completed latency_us = 70139 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c86e7c54-2f48-4d69-86ad-5809cf3ded68 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.379042Z&order=descending&limit=1&project=41c1c314-b812-4fb3-ab31-28abfa63ce10
116912026-03-03T16:56:55.450ZINFOtest_metrics (external client test context): client received response status = 200
116922026-03-03T16:56:55.450ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
116932026-03-03T16:56:55.450ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
116942026-03-03T16:56:55.450ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1 version = 2026021900.0.0
116952026-03-03T16:56:55.450ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
116962026-03-03T16:56:55.450ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
116972026-03-03T16:56:55.450ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
116982026-03-03T16:56:55.450ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
116992026-03-03T16:56:55.451ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117002026-03-03T16:56:55.452ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117012026-03-03T16:56:55.452ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117022026-03-03T16:56:55.453ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117032026-03-03T16:56:55.454ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
117042026-03-03T16:56:55.454ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
117052026-03-03T16:56:55.454ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117062026-03-03T16:56:55.454ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117072026-03-03T16:56:55.454ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117082026-03-03T16:56:55.456ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
117092026-03-03T16:56:55.456ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117102026-03-03T16:56:55.456ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117112026-03-03T16:56:55.456ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117122026-03-03T16:56:55.457ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
117132026-03-03T16:56:55.459ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
117142026-03-03T16:56:55.459ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117152026-03-03T16:56:55.459ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117162026-03-03T16:56:55.460ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117172026-03-03T16:56:55.461ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
117182026-03-03T16:56:55.461ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
117192026-03-03T16:56:55.461ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117202026-03-03T16:56:55.461ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117212026-03-03T16:56:55.461ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117222026-03-03T16:56:55.462ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
117232026-03-03T16:56:55.462ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117242026-03-03T16:56:55.462ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117252026-03-03T16:56:55.462ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117262026-03-03T16:56:55.463ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
117272026-03-03T16:56:55.465ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
117282026-03-03T16:56:55.465ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117292026-03-03T16:56:55.465ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117302026-03-03T16:56:55.465ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117312026-03-03T16:56:55.465ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117322026-03-03T16:56:55.465ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117332026-03-03T16:56:55.466ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117342026-03-03T16:56:55.467ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117352026-03-03T16:56:55.467ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117362026-03-03T16:56:55.467ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117372026-03-03T16:56:55.467ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117382026-03-03T16:56:55.469ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117392026-03-03T16:56:55.470ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117402026-03-03T16:56:55.470ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117412026-03-03T16:56:55.470ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117422026-03-03T16:56:55.470ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117432026-03-03T16:56:55.470ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117442026-03-03T16:56:55.471ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117452026-03-03T16:56:55.471ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
117462026-03-03T16:56:55.471ZDEBGtest_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
117472026-03-03T16:56:55.471ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
117482026-03-03T16:56:55.471ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
117492026-03-03T16:56:55.471ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
117502026-03-03T16:56:55.471ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
117512026-03-03T16:56:55.471ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
117522026-03-03T16:56:55.473ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117532026-03-03T16:56:55.473ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117542026-03-03T16:56:55.473ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117552026-03-03T16:56:55.473ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117562026-03-03T16:56:55.473ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
117572026-03-03T16:56:55.474ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
117582026-03-03T16:56:55.474ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
117592026-03-03T16:56:55.474ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 40827
117602026-03-03T16:56:55.474ZDEBGtest_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
117612026-03-03T16:56:55.474ZDEBGtest_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
117622026-03-03T16:56:55.474ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
117632026-03-03T16:56:55.475ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117642026-03-03T16:56:55.477ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117652026-03-03T16:56:55.478ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
117662026-03-03T16:56:55.479ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 2 table_name = fields_string
117672026-03-03T16:56:55.479ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
117682026-03-03T16:56:55.480ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 1 table_name = measurements_i64
117692026-03-03T16:56:55.480ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
117702026-03-03T16:56:55.481ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:55.450168164' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
117712026-03-03T16:56:55.483ZINFOtest_metrics (dropshot_external): request completed latency_us = 33089 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = c55b9ef0-8d72-4e09-81a2-13a8bc43b788 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.450168164Z&order=descending&limit=1
117722026-03-03T16:56:55.483ZINFOtest_metrics (external client test context): client received response status = 200
117732026-03-03T16:56:55.484ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
117742026-03-03T16:56:55.484ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
117752026-03-03T16:56:55.484ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1 version = 2026021900.0.0
117762026-03-03T16:56:55.484ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
117772026-03-03T16:56:55.484ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
117782026-03-03T16:56:55.484ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117792026-03-03T16:56:55.484ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117802026-03-03T16:56:55.485ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117812026-03-03T16:56:55.486ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117822026-03-03T16:56:55.486ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117832026-03-03T16:56:55.487ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117842026-03-03T16:56:55.488ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
117852026-03-03T16:56:55.488ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
117862026-03-03T16:56:55.488ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117872026-03-03T16:56:55.488ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117882026-03-03T16:56:55.488ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117892026-03-03T16:56:55.489ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
117902026-03-03T16:56:55.489ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117912026-03-03T16:56:55.489ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117922026-03-03T16:56:55.490ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117932026-03-03T16:56:55.491ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
117942026-03-03T16:56:55.493ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
117952026-03-03T16:56:55.493ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
117962026-03-03T16:56:55.493ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
117972026-03-03T16:56:55.493ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
117982026-03-03T16:56:55.494ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
117992026-03-03T16:56:55.494ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
118002026-03-03T16:56:55.494ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118012026-03-03T16:56:55.494ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118022026-03-03T16:56:55.495ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118032026-03-03T16:56:55.496ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
118042026-03-03T16:56:55.496ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118052026-03-03T16:56:55.496ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118062026-03-03T16:56:55.496ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118072026-03-03T16:56:55.497ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
118082026-03-03T16:56:55.499ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
118092026-03-03T16:56:55.499ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118102026-03-03T16:56:55.499ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118112026-03-03T16:56:55.499ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118122026-03-03T16:56:55.499ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118132026-03-03T16:56:55.499ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118142026-03-03T16:56:55.499ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118152026-03-03T16:56:55.501ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118162026-03-03T16:56:55.501ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118172026-03-03T16:56:55.501ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118182026-03-03T16:56:55.501ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118192026-03-03T16:56:55.502ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118202026-03-03T16:56:55.504ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118212026-03-03T16:56:55.504ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118222026-03-03T16:56:55.504ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118232026-03-03T16:56:55.504ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118242026-03-03T16:56:55.504ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118252026-03-03T16:56:55.504ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118262026-03-03T16:56:55.505ZTRACtest_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
118272026-03-03T16:56:55.506ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118282026-03-03T16:56:55.506ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118292026-03-03T16:56:55.506ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118302026-03-03T16:56:55.506ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118312026-03-03T16:56:55.507ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118322026-03-03T16:56:55.509ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118332026-03-03T16:56:55.511ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
118342026-03-03T16:56:55.513ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:55.483986217' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
118352026-03-03T16:56:55.515ZINFOtest_metrics (dropshot_external): request completed latency_us = 31150 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 6b6d3a74-9d8a-46b3-8d72-009ee9e16282 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.483986217Z&order=descending&limit=1
118362026-03-03T16:56:55.515ZINFOtest_metrics (external client test context): client received response status = 200
118372026-03-03T16:56:55.515ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118382026-03-03T16:56:55.516ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118392026-03-03T16:56:55.516ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1 version = 2026021900.0.0
118402026-03-03T16:56:55.516ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118412026-03-03T16:56:55.516ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118422026-03-03T16:56:55.516ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118432026-03-03T16:56:55.516ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118442026-03-03T16:56:55.516ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118452026-03-03T16:56:55.518ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118462026-03-03T16:56:55.518ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118472026-03-03T16:56:55.518ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118482026-03-03T16:56:55.519ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
118492026-03-03T16:56:55.519ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
118502026-03-03T16:56:55.519ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118512026-03-03T16:56:55.519ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118522026-03-03T16:56:55.520ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118532026-03-03T16:56:55.521ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
118542026-03-03T16:56:55.521ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118552026-03-03T16:56:55.521ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118562026-03-03T16:56:55.521ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118572026-03-03T16:56:55.522ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
118582026-03-03T16:56:55.524ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
118592026-03-03T16:56:55.524ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118602026-03-03T16:56:55.524ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118612026-03-03T16:56:55.524ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118622026-03-03T16:56:55.525ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
118632026-03-03T16:56:55.525ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
118642026-03-03T16:56:55.525ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118652026-03-03T16:56:55.525ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118662026-03-03T16:56:55.526ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118672026-03-03T16:56:55.527ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
118682026-03-03T16:56:55.527ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
118692026-03-03T16:56:55.527ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
118702026-03-03T16:56:55.527ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
118712026-03-03T16:56:55.528ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
118722026-03-03T16:56:55.530ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
118732026-03-03T16:56:55.530ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118742026-03-03T16:56:55.530ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118752026-03-03T16:56:55.530ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118762026-03-03T16:56:55.530ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118772026-03-03T16:56:55.530ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118782026-03-03T16:56:55.530ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118792026-03-03T16:56:55.532ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118802026-03-03T16:56:55.532ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118812026-03-03T16:56:55.532ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118822026-03-03T16:56:55.532ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118832026-03-03T16:56:55.533ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118842026-03-03T16:56:55.535ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118852026-03-03T16:56:55.535ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118862026-03-03T16:56:55.535ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118872026-03-03T16:56:55.535ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118882026-03-03T16:56:55.535ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118892026-03-03T16:56:55.535ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118902026-03-03T16:56:55.536ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118912026-03-03T16:56:55.536ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118922026-03-03T16:56:55.537ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118932026-03-03T16:56:55.537ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118942026-03-03T16:56:55.538ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118952026-03-03T16:56:55.539ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118962026-03-03T16:56:55.541ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
118972026-03-03T16:56:55.544ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:55.515833648' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
118982026-03-03T16:56:55.545ZINFOtest_metrics (dropshot_external): request completed latency_us = 29890 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 376f19ab-9e71-4efa-b0cc-a16b457141ad response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.515833648Z&order=descending&limit=1
118992026-03-03T16:56:55.546ZINFOtest_metrics (external client test context): client received response status = 200
119002026-03-03T16:56:55.546ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119012026-03-03T16:56:55.546ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119022026-03-03T16:56:55.546ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1 version = 2026021900.0.0
119032026-03-03T16:56:55.546ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119042026-03-03T16:56:55.546ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119052026-03-03T16:56:55.546ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119062026-03-03T16:56:55.546ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119072026-03-03T16:56:55.547ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119082026-03-03T16:56:55.548ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119092026-03-03T16:56:55.548ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119102026-03-03T16:56:55.548ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119112026-03-03T16:56:55.549ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
119122026-03-03T16:56:55.549ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
119132026-03-03T16:56:55.549ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119142026-03-03T16:56:55.549ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119152026-03-03T16:56:55.550ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119162026-03-03T16:56:55.551ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
119172026-03-03T16:56:55.551ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119182026-03-03T16:56:55.551ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119192026-03-03T16:56:55.551ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119202026-03-03T16:56:55.552ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
119212026-03-03T16:56:55.554ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
119222026-03-03T16:56:55.554ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119232026-03-03T16:56:55.554ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119242026-03-03T16:56:55.554ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119252026-03-03T16:56:55.555ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
119262026-03-03T16:56:55.555ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
119272026-03-03T16:56:55.555ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119282026-03-03T16:56:55.555ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119292026-03-03T16:56:55.556ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119302026-03-03T16:56:55.556ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
119312026-03-03T16:56:55.556ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119322026-03-03T16:56:55.556ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119332026-03-03T16:56:55.557ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119342026-03-03T16:56:55.558ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
119352026-03-03T16:56:55.560ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
119362026-03-03T16:56:55.560ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119372026-03-03T16:56:55.560ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119382026-03-03T16:56:55.560ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119392026-03-03T16:56:55.560ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119402026-03-03T16:56:55.560ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119412026-03-03T16:56:55.560ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119422026-03-03T16:56:55.561ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119432026-03-03T16:56:55.564ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119442026-03-03T16:56:55.564ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119452026-03-03T16:56:55.564ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119462026-03-03T16:56:55.564ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119472026-03-03T16:56:55.564ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119482026-03-03T16:56:55.564ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119492026-03-03T16:56:55.566ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119502026-03-03T16:56:55.568ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119512026-03-03T16:56:55.570ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
119522026-03-03T16:56:55.572ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (12379067900625785140) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:55.546386266' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
119532026-03-03T16:56:55.572ZWARNtest_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
119542026-03-03T16:56:55.572ZTRACtest_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
119552026-03-03T16:56:55.572ZDEBGtest_metrics (results-sink-cluster): inserting 15 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
119562026-03-03T16:56:55.572ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119572026-03-03T16:56:55.572ZTRACtest_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119582026-03-03T16:56:55.572ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119592026-03-03T16:56:55.572ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119602026-03-03T16:56:55.572ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119612026-03-03T16:56:55.572ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119622026-03-03T16:56:55.572ZDEBGtest_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119632026-03-03T16:56:55.572ZERROtest_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119642026-03-03T16:56:55.572ZDEBGtest_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119652026-03-03T16:56:55.573ZTRACtest_metrics (dropshot): incoming request local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 6a2ae460-ee01-4e2d-a896-6a6303d74b84 uri = /913233fe-92a8-4635-9572-183f495429c4
119662026-03-03T16:56:55.578ZINFOtest_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5410 local_addr = 127.0.0.1:44271 method = GET remote_addr = 127.0.0.1:44728 req_id = 6a2ae460-ee01-4e2d-a896-6a6303d74b84 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
119672026-03-03T16:56:55.579ZINFOtest_metrics (dropshot_external): request completed latency_us = 32622 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = ce8c4ab6-a03b-4ccb-9311-3b8b449a525b response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.546386266Z&order=descending&limit=1
119682026-03-03T16:56:55.579ZTRACtest_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119692026-03-03T16:56:55.586ZDEBGtest_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119702026-03-03T16:56:55.586ZTRACtest_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119712026-03-03T16:56:55.586ZTRACtest_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 44271
119722026-03-03T16:56:55.587ZDEBGtest_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
119732026-03-03T16:56:55.587ZDEBGtest_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854
119742026-03-03T16:56:55.592ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
119752026-03-03T16:56:55.592ZINFOtest_metrics (external client test context): client received response status = 200
119762026-03-03T16:56:55.592ZINFOtest_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:40151/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
119772026-03-03T16:56:55.593ZTRACtest_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
119782026-03-03T16:56:55.593ZDEBGtest_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1 version = 2026021900.0.0
119792026-03-03T16:56:55.593ZTRACtest_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
119802026-03-03T16:56:55.593ZDEBGtest_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
119812026-03-03T16:56:55.593ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119822026-03-03T16:56:55.593ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119832026-03-03T16:56:55.593ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119842026-03-03T16:56:55.595ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 32 table_name = fields_string
119852026-03-03T16:56:55.595ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
119862026-03-03T16:56:55.595ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119872026-03-03T16:56:55.595ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119882026-03-03T16:56:55.595ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119892026-03-03T16:56:55.596ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = fields_u16
119902026-03-03T16:56:55.596ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
119912026-03-03T16:56:55.596ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
119922026-03-03T16:56:55.597ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
119932026-03-03T16:56:55.597ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
119942026-03-03T16:56:55.597ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
119952026-03-03T16:56:55.597ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
119962026-03-03T16:56:55.598ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = fields_uuid
119972026-03-03T16:56:55.598ZTRACtest_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
119982026-03-03T16:56:55.598ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
119992026-03-03T16:56:55.598ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120002026-03-03T16:56:55.598ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120012026-03-03T16:56:55.599ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120022026-03-03T16:56:55.600ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
120032026-03-03T16:56:55.602ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
120042026-03-03T16:56:55.602ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120052026-03-03T16:56:55.602ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120062026-03-03T16:56:55.602ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120072026-03-03T16:56:55.603ZDEBGtest_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = 4ccebef7-be8f-4436-8d44-c75ba8933854 n_rows = 16 table_name = measurements_histogramu64
120082026-03-03T16:56:55.603ZTRACtest_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
120092026-03-03T16:56:55.603ZTRACtest_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
120102026-03-03T16:56:55.604ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
120112026-03-03T16:56:55.604ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120122026-03-03T16:56:55.604ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120132026-03-03T16:56:55.604ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120142026-03-03T16:56:55.605ZTRACtest_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
120152026-03-03T16:56:55.605ZTRACtest_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
120162026-03-03T16:56:55.605ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
120172026-03-03T16:56:55.605ZDEBGtest_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
120182026-03-03T16:56:55.606ZDEBGtest_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
120192026-03-03T16:56:55.608ZDEBGtest_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
120202026-03-03T16:56:55.608ZTRACtest_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120212026-03-03T16:56:55.608ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120222026-03-03T16:56:55.608ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120232026-03-03T16:56:55.608ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120242026-03-03T16:56:55.608ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120252026-03-03T16:56:55.609ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120262026-03-03T16:56:55.610ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120272026-03-03T16:56:55.613ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120282026-03-03T16:56:55.613ZTRACtest_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120292026-03-03T16:56:55.613ZTRACtest_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120302026-03-03T16:56:55.613ZTRACtest_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120312026-03-03T16:56:55.613ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120322026-03-03T16:56:55.613ZDEBGtest_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120332026-03-03T16:56:55.615ZDEBGtest_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120342026-03-03T16:56:55.617ZDEBGtest_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120352026-03-03T16:56:55.619ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
120362026-03-03T16:56:55.622ZTRACtest_metrics (clickhouse-client): executing SQL query id = 0bd623cd-5825-4477-b3ca-107a738cbd60 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (7763646387282271213) AND timestamp >= '2026-03-03 16:56:40.140697500' AND timestamp < '2026-03-03 16:56:55.592928740' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
120372026-03-03T16:56:55.623ZINFOtest_metrics (dropshot_external): request completed latency_us = 30590 local_addr = 127.0.0.1:40151 method = GET remote_addr = 127.0.0.1:36496 req_id = 0346a96f-6ecf-41a1-a287-18970e277867 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T16:56:40.140697500Z&end_time=2026-03-03T16:56:55.592928740Z&order=descending&limit=1
120382026-03-03T16:56:55.624ZINFOtest_metrics (external client test context): client received response status = 200